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THE CONDITIONS OF BELIEF IN ADVERTISING 


A. T. PoFYEUBtURfiH 
Columbia University 


A reader of the literature dealing with the Psychology of Ad¬ 
vertising finds mimerous artielea written upon the effectiveness 
of various mechanical devices, the attention and memory value 
of size of space and the position on the page, the influence of 
color, style of type and its arrangement, the effectiveness of 
repeating the advertisement, etc. The problem of arousing the 
(Sonfidenefl of the consumer in the article advertised, the cendi- 
tiona on which it depends, how belief in advertisements may be 
created and how it may be measured have been very lightly 
touched in experimental studies. The importance of these mat¬ 
ters ia emphaaized in every textbook on advertiaing. The fact 
that the American people are each year induced to squander 
many miUions of dollars in worthless securities through the 
medium of advertising in some form, ami that warnings seem 
quite ineffective in protecting them, makes one curious about the 
basis of belief in advertising. It ia not enough to any that the 
American people like to be fooled and that there is no scheme 
too wild to arouse the confidence of n large proportion of them. 
The advertiser should know that action la dependent upon belief 
and that belief in advertising depends upon conditions, some of 
which at least are under his control. 

Belief ie indeed a complex mental state and it may depend at 
any time upon a great variety of factors, the moat common of 
which are listed in textbooks of psychology and advertising. It 
is nob the purpose of this report to repeat such lists but to cite 
$ome experimental lividence from the field of advertising to show 
the importance of a few of the conditions of belief for success in 
advertising. 

1. Belief ia rarely the result of reasoning. One does not go 
through tlie proceases of logic to establish his beliefs. If logic is 
used at all it is to justify a belief already established, A atrik- 
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ing illustration of the separation of reasoning and belief is found 
in the case of the insane patient who firmly believed himself to 
be the son of a king, and yet whose reason was intact enough to 
enable him to solve complicated mathemnticnl problems. 

The advertising of the New Gillette ra'/^or offered a good oppor¬ 
tunity for studying the relation between belief niid reasoning.* On 
May IG, 1921, the Gillette Razor Comimny nnnouiiced "a new 
triumph of American inventive genius of startling interest to 
^vevy man with a beard to ghave." The advcrtiscmenlH state 
that the "'fulcrum shoulder, overhanging cap and clinnneled 
guard” were the three innovations which mode jiossible 'Tor the 
first time in any ra2;or, micrometric control of bhule position." A 
dlagrcLm showed “how the blade is bifiexed between overhanging 
cap and fulcrum shoulder, It is flexed once into tho inside curve 
of the cnp. This is the minor flexure—the curve for easy gliding 
action and play of the wrist in shaving. It is flexed a second 
time—more sharply and in a shorter radius—by i)io grip of the 
overhanging cap the whole length of tho fulcrum shoulder. Thi.s 
is the major flexure." This arrangement provided an exactness 
of adjustment to 1-lOflO of an inch. Advertisements eontnining 
tliG above information and well illustrated were given to llfLy- 
seven men, college students and university graduates, together 
with a series of seven questions intended to test both their belief 
in the new razor and their understanding of it. The aiiswcvs to 
these questions showed that all the students agreed that the now 
razor was better than the old one, and that they would rather pay 
$B.0& for the new one than $1,00 or $2,DO for tho old one. In 
supporting their belief they were allowed to consult Llie udvertisc- 
ment as much as they wished. They quoted the 'Tulcruiii shoulder, 
overhanging cap and channeled guard," which made possible 
"micrometric control of blade position," but nob one of them could 
explain how the micrometric control was obtained or what ad¬ 
vantage there Would be in having such micrometric control. Tliey 
believed that the "channel guard" was an improvement although 
they Could not tell why it was an improvemetit. As to the import¬ 
ance ,o£ major and nuinor flexures they were entirely ignorant. 
Five minutes examination of an enlarged diagram of the now razor 
improved their understanding of the razor little or not at all. 
Here is a belief effective for the purpose of the advertiser in 
spite of the inability of the reader to support his belief with 
reason. This experiment is quoted not to show that the adver¬ 
tisement is poor, but merely Lo show that in advertising reason- 


late^^ciatc^ nml U\q writer, wlilch wUl be nt a 
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ing is noL needed fco create belief. Whether the space in the ad¬ 
vertisement devoted to argument might have been more profitably 
filled, is however an interesting question. 

2. It is not necessarily that which is true that is believed. 
The fact that a sLatenicnt in nn advertisement is true will not 
guiwantec belief on the part of the readers of it. The truth may 
he too startling and surprising to be believed, and in some cases it 
might be more o flue Live to tell half the truth than the whole truth. 
Three advertiseinenta were chosen for investigation in this con¬ 
nection, each of them presenting rather unusual information. In 
each case the truth of the statement.^ made was vouched for by 
reTiable individual.s. Each of the advertisements was presenti;d 
to 100 people, together with a series of statements about them. 
The individuals were to simply check those statements that most 
nearly represented their opinion about the advertisements. The 
statements were carefully prepared so ns to avoid suggestion. The 
studies of the three advertisements will bo reported separately: 

Taijlor Trunk AdvertisemenL This advertisement showed the 
IjlioLograph of a huge elephant standing on a trunk. The picture 
was accompanied by a signed statement as to the genuineness of 
Llie photograph, and by statements to the effect that the trunk 
was taken from the regular stock. Statistical treatment of the 
replies of the persons tested showed that 38 percent of them 
doubted the truth of the Htatemonts made in the advertisement; 
2-1 per cent questioned the genuineness of the photograph; and 
21 percent believed that it would be impossible to conatruct a 
trupli strong enoxigh to witVistanA sneh a weight. That is, in Itotti 
onc-hfth to two-fifths of the persons tested the advertisement cre¬ 
ated a state of mind adverse to the purchase of the article. 

Stanley Vacuum Bottle Advcrii&emenL This advertisement rep¬ 
resented a vacuum bottle falling from a high window, and de¬ 
scribed an incident in which a Stanley bottle had accidentally 
fallen from an eighth story window and suffered only a dent, 
which did not at nil interfere with its usefulness. The replies to 
the questions submitted with this advertisement showetl that 31 
percent doubted the truth of the statements, while 22 percent 
refused to believe that n vacuum bottle sufhciently strong to sur¬ 
vive the fall could possibly be constructed. 

Edison Phonograph Advertisement. This advertisement pic¬ 
tured one of the well known “tone tests" demonstrations in Car¬ 
negie IInil, Pittsburg. It showed the .stage occupied by a well 
known singer and nn Edison phonograph, with the audience in the 
background. On the advertisement there were reproduced a 
nninber of cli])ping.s from the daily papers describing the remarlc- 
iiblc denionstralion, each clipping making the statement in one 
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form or anothev that iio otic in the audience of 2,GOO pcoiile could 
distinguish between the voice of the Tiingev nml its vcproduction. 
Replies from 100 people to eight questions about this advertise¬ 
ment may be summed up as foUowa: 77 percent doubted the 
truth of the statements contained in the (idvcrtisement.s. 7d per* 
cent believed that they could tell the (imcrencc between n real 
voice and its reproduction by any phonograph. percent be¬ 

lieved that mechanical sounds would betray tlm pli()nngrai)h in 
these *<tone testa/' 49 percent believed that some Unr\\ of liickery 
or deception was practicedv BO percent believed that the urlist 
iuteTTtionaUy imita^d the phonograph. 44 percent believed tluil 
a apecialiy constructed phonograph was used for the (.leiuaUHtru- 
tion rather than a atock instrument. CB percent belicvc<l that no 
phonograph could successfully undergo such a tost. 90 percent 
stated that an nctunl demonstration of the "tone test" such as 
that described in the advertisement would nob convince ihoni of 
their inability to distinguish between the hunnin voice and its 
reproduction. 

This advertisement seemed especially e/Tcctivc in failing to cronte 
belief in the minds of its readers, when over three-four Ilia of 
them doubted the truth of the statements. The writer rccom^ 
mended in this case a less extreme and loss startUng form of 
appeal which should not arouse the antagonism manifested in this 
experiment, 

Thus far the negative side of the question lina been presented- 
If belief in an advertisement does not depend upon the li’uth of 
the statements made and does not depend upon the reasoning of 
the reader, on whab does it depend? To state the matter simply, 
we may say that ideas which are present in the mind and aro not 
interfered with by any opposing ideas wiU be believed. This is 
fnerely a bare atatemeafc of the law of suggestion and to comply 
with it in. advertising, con dieting ideas should be prevented from 
entering the mind. Theve are many conditions on which such un¬ 
disturbed acceptance of ideas depends, Only three will be men- 
tiomid here, 

1, The ideas nroxised by an advertisement must not conflict too 
sharply with the reader’s experience- Introspection a voluntoGred 
by many of the 100 subjects who served in the experiments just 
described indicated that their past experiences with trunlca, va¬ 
cuum bottles and phonographs furnished conflicting ideas which 
the advertisements were not suiflciently powerful to overcoino. 
This was especially true in the case of the phonograph advertiae- 
ment where doubt was expressed in n largo percentage of the 
cases, 

An experimental study of an advertising campaign that failed 
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showed dearly the need for complying with the conditions of 
belief, '^Radior Products/’ a scries of toilet preparations were 
introduced into this country by an English firm. The appeal 
contained in the advertising may be illustrated by the following 
quotation taken from one of the advertisements: “Radior is the 
magic new word in the book of beauty. It means the triumphant 
union of the finest complexion preparations with actual radium. 
Its content of radium works the miracle of nature. It purifies 
the skh\, gives it the health to regain its yeuthfulnesa and ioveU- 
ncss." The container of these preparations was represented as 
emanating rays which were very suggestive of bolts of lightning. 
These toilet preparations could not be sold—the campaign had 
failed. Why? One possible reason for the failure was that the 
suggestion to apply radium on the skin for toilet purposes con¬ 
flicted too sharply with people’s opinions about radium. In order 
to discover what people believed about radium, a questionairc was 
carefully prepared in the form of a True-False test and submitted 
to 400 people, comprising a well-to-do, well-educated group, a 
group of average intelligence and financial standing and a special 
group of pci'son.s working in ''Beauty Parlors.” The questionaive 
is reproduced below. It was constructed so ns to minimize the 
influence of auggestion and to correct for it when it did occur, as 
for instance in combining replies from question 2 and 7. Ques¬ 
tions 3, 5 and 10 were inU^oduced as fillers and had no special 
significance. 

Read the first statement on thia sheet. If you feet that it is 
true, underline the word "True,” If you feel that it is false, 
underline the word “Palae." Then judge each of the other state¬ 
ments as true or false. If you do not know, guess at it. This 
sample statement is false and is marked as it should be: 


There are eight days in the week.True False 

1— Radium is a deadly poison..True False 

2— Radium is so costly that it cannot be 

used for commercial purposes.True False 

3— Treatments with radium will make 

the hair grow . True False 

4— Radium ia used in the treatment of 

such discuses as cancer...True False 

6— Radium is a substance which gives of! light.True False 

G—Radium whdu applied in diluted form gives 

a hcolthful stimulation to the akin.True False 

7— Radium is now used in the inanufacturo 

of many products in common use.True False 

8— Radium causes burns when it comes into 

contact with the skin.True False 
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9 _Toilet preparations containing radium nre to 

be recommended for their beneficial cfTccts,... 
10—Certain forms of radium can be obtained 

at little cost .....»... 

11 _Radium proparnbions should not bo ii*sed 

except on the advice of a physician..... 

12—Radium products are gaininff popularity an 

mild stimulants to hcr.lth Krn\vLb. 

Read the following question and aiiawei' it by n 
or 


....True 

False 

....True 

False 

,..,vTrurj 

False 


False 

ndei'lining 



If yon should be told that tbevG was i\ toLlet prciiaruthni of hiRh 
quality and moderate price and 'vvbich contained n niiiuito rinoutity 
of radium, would your ItnowledKo of the edects of rudiuni he 
such as to malce you want to buy it?.Yos Nn 


Nothing need be said here coiiccrning the difiorence* in the 
reactions of the difTcrent groups to the qucationiiire, oxeei>L that 
the most intelligent group had the strongest react ion against 
radium-containing products, and that the “Beauty Parlor” workors 
had the least antagonism. Inquiry among these people indicatod 
that some of them had confused radium with tho violet vuy whieji 
was at the time a very popular form of treatment with the in. The 
results of the study of the que.stionaire may be siunmarized ns 
follows *. 

Forty-eight per cent of the persons tested believed that radium 
is a deadly poison; 80 per cent believed that it cau.ses hums when 
it comes in contact with tho skin; 89 per cent believed that ratlium 
preparations should be used only upon tho advice of a physician; 
71 per cent said that they would not buy any kind of toilet prepa¬ 
ration that they knew contained oven a minute quantity of radium; 
90 per cent thought of radium ns a substance used for the tveal- 
ment of cancer. The whole experiment may be summed up in the 
statemeut that- about 70 per cent of all the rcplioB indicated 
opinions unfavorable to radiuin-coiitaining products as toilet 
pYeparations. The basis of this unfavorable reaction could easily 
be traced to the people's accumulated experiences of radium. 
Clippings of all articles dealing' with radium and appoariiig in 
newspapers and magazines were collected for a short period. 
Practically all of them emphasized the harmful elfects of radium 
and the dangers incurred in handling it, instead of any beneJiciul 
properties it might possess. 

This is a clear case of ‘the: iuahilHy of an ndverLiaing camp nigu 
to overcome the resistance established by expcrrehce. To create u 
favorable attitude towel radium-containing ’ products as toilet 
preparations hy nn educational campaign conducted in news- 
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pjipGi’s imil might conceivably have been possible, But 

it cor La inly would have been impracticable- 

Tlie mass of expei'ieiices upon which beliefs rest is gradually 
ficcuiuulatirig and being mod 1 lied by additions. As some one has 
siiid> “Confidonce Is at the same time stable and fragile." It is 
stable because of the bulk of cxpericnce.s on which it rests; it is 
fragile licciUise iL i.s subject to cliiuige from new experiences. A 
.supposed bargain which is found to bo not a bargain, a deroguiory 
new.ipaper rei)orl abtml a stove, a mi.4print in the iulverti.%od price 
of an article; any one of tho.se may he the experience tliat will 
introduce a conflicting idea into the mind of n consiuner and upset 
the conditions favorable for hi.s belief. The advertiser, appealing 
as bo docs to populations, cannot take account of the shiftings of 
individual experience and belief, but he must Lake account of the 
wido.spread and slowly accunuilating experiences which may 
a mo Lint to powerful prejudice.s against hi.s appeal. 

2. Ideas that are to create Ijelief niiist come from an authorita¬ 
tive souvci'- This is a well-known law of suggeaUon, The 
hypnotist can do nothing wiLhoiit his air of authority and the 
snbject'i;, recognllioii of it. We arc accusLomed to believe the - 
.stnLemonLs made by n person in wdiom wc have confidence, and to 
believe what i.s v>riuLc(l in a medium which we consider authorita¬ 
tive. Even if there in conllict wnth one’s own experience, he will 
.sometimes accept the contrary experience of another person as a 
biisi.s for belief if he have sufiicient eonfideme in the other person. 
But even then the new experience may not be too connieting. 
Advert!sens liave for years striven to develop an Htmo.sphurG of 
confidence and authority by all the devices at their command. 
The present experiment was intended to nioasuvo in a tentative 
fashion the degree of confidence which an advertbsement can create 
in comparison with other forms of publication. I have compared 
tliG degree of belief or doubt aroused by the throe advertiaomonbs 
previously desevibed (namely Tuylor Trunks, Stanley Vacuum 
Bottles and Edison Phonographs) witli the belief aroused by 
cssoiitifilly the .same staLemont.s coming from a reputable journal. 
In order Lo make such a comparison, the facts stated in each 
advertisemeuL were prepared in the form of li news item abstracted 
from an engineering magazine. One .such abstract will illustrate 
the cliaracLer of all. These abstracts were presented to a group 
of 100 per son.s of Uio .same general character as those tested in 
the curlier experimenU, but who knew nothing of those experi¬ 
ments or nothing of the purpose of the present experiment. Along 
with the abstract of each adverLiseincnL was a .series of <iiiestions 
a.s nearly as pos.Hi\>le like those used in the lest with the advertise¬ 
ments. As fiir a.s we were able to ascertain, no one doubted the 
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ftUtKsuticity of the news nbstr/icts. Insbotid of reportiTiff the rc^ 
aiilta of tke three questionnircs in dctnil, it will be HufTicient to 
compare for each of the three cases the number of replies indicate* 
ing doubt in the advertisement and doubt in the nows item. It 
must be rem&mbered that the nows item meiibioiied no trnde^iiamed 
article nor indicated any connection with specially advertised 
goods. 

The following is an extract from--Magazine of June, 

1921, Bead it carefully and then onswer the questions given be¬ 
low, by scratching out with a pencil the part of each that docs 
not give your opinion. 

A Remahkablb Shock Resisting Consthuction 

new type of wardrobe trunk was recently put through a 
remarkable test of strength. The five-Lon elephant bcloi^ging to 
the l^ew York Hippodrome was made to stand on the empty trunk. 
An exammation of the trunk following the test showed that it 
had withstood the great shock without tUmage. 

Interesting photographs were made of the test, showing the 
elephant mounting the trunk, seated upon ii, and then stepping 

off of it." 

1— I believe—doubt—do not believe—the statements made in the 
above extract. 

2— I feel that the photographs that portray the test are—arc 
not—ECTvuine, 

3— I do—do not—^believe that a trunk could bo made strong 
enough to successfully •undergo the teat described- 

Percentage of replies expressing 

doubt In the Ads hi Che Neios Items 

Taylor Trunks .2B per cent 43 per cent 

Stanley Vacuum Bottles ....27 per cent 43 per cent 

Edison Phonographs .55 per cent 40 per cent 

In two of the cases it will he noted that there was greater con¬ 
fidence in the advertisement than in the news clipping, while in 
the third there was greater confidence in the news clipping. An 
examination of the three ndvertisements did not ofForcl on entirely 
satisfactory explanation for the shift of belief in the case of the 
third advertisement. It seems safe to conclude from those records 
that although belief in certain advertisements may be low, they 
may carry at least as much authority in presenting a set of facts 
as can be conveyed by a news article. The doubt in the cases wc 
have studied is the effect rather of conflicb of ideas with experi¬ 
ence, than the effect of the use of nn uiiauthoritalivc medium of 
expTosaion. Introspections volunteered by the subjects suggest that. 
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illustrations and especially photographs Used in the advertise¬ 
ments tend to strengthen belief. Unless one suspects trickery, as 
some of our subjects did, looking at a picture ought to carry with 
it greater weight in establishing belief than merely reading 
printed matter. Even if Mark Twain was right in advising that 
one believe only half that he sees and nothing that he hears, the 
advantage in favor of the picture is obvious. 

3. There is a third important condition of belief, namely, that 
we tend bo believe whnt arouses our desires, our fears and our 
emotions generally* I have no experimental evidence to offer in 
this connection, and know of none in the field of advertiaing. But 
evidence for the importance of this factor may be drawn from 
psychology. TVm. James has said, man who has no belief in 
ghosts by daylight will temporarily believe in them when alone at 
midnight, lie feels his blood curdle aba mysterious sound or vision, 
his heart thumping and his legs impelled to flee." In strong emo¬ 
tion we might find the condition responsible for the belief in the 
bargain counter. The politician finds no difficulty in honestly be¬ 
lieving what best fits in with his aspirations, while hig opponent 
may as honestly believe the opposite and for a like reason. If 
one really wants a certain suit of clothes or an automobile which 
costs more than ho should pay, he may honestly believe that he 
is making an economical purchase. Once a belief has been estab¬ 
lished in this way, logic and rensomng may be used to support it. 

These three conditions of belief which I have described repre¬ 
sent three important variables in the formula for advertising suc¬ 
cess. For most advertising situations they are unknown variables 
which may interact in a very complex manner. But they may be 
discovered by careful examination. That they are not always 
sought or discovered, is clear from the cases I have cited which 
were taken from advertising already used. Three questions might 
well be asked about every advertisement: (I) What adverse be¬ 
liefs and experiences does it have to meet in the minds of con¬ 
sumers? (2) Will the nubhority which it wears by its mode of 
presentation or by the medium in which it appears enable it to 
create belief? (3) Does the appeal used arouse desires which will 
in turn create belief in blie advertised article? These arc hurnan 
behavior questions that psychological methods will enable the ad¬ 
vertiser to answer before the advertising ia used as well as after 
the money has been spent upon broadcasting it. 
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?rom the Paycholofficnl LiibonUoxy of Indiaiui Univoraity 
By H, D. Kitson, C. W, BarNes, and C. lOPi't:N>,ATz 


^X, HiGHT AND t^rr Hand Pages in Magazines 

A. considerable c^inounL of discus.sion Ima c€int(Me(i nroinui the 
question as to which is the more favorable ^loHilion U)V [ulvertisc- 
ments in Tnaenzmes, the right or loft-hnnii page, The question 
has usually been approached through the InbornLory method, Hub- 
jeets viewing the womcnLnrily cxpo.'Jcd page>s of n "(lummy'* or n 
real magagiuG and then writing down nil they have seen in the 
onlev in which they have seen it. With this technic Adams' re- 
ports a vaUie of the right hand page which is to LhnL of tlie left us 
100 is to C5. That is, he cstiinates the right linncl to he fifty per 
cent superior, Kotchkiss nnd Prnnken’ eatiiuatc from their inve,^- 
Ugalion that the right-hand page of a maga'Mnc'ia worth five per 
cent more than the left-hand page. 

In Order to ;SecUre nddifclopnl light Upon the question the writers 
approached the problem with the historical tcchiiict scjelcing to dis¬ 
cover the frequency willi which udvertiHCva aetiuUly u^icd the right- 
hand and laft-hand pages. 

The materials used were 1082 conSGCiitivc pngoa of a cl vor Li sing 
matter in the Amcrlcnn Magazine and 1000 in the’ Siiturdny Eve¬ 
ning Post, for the year 1922, Beginning with the Avat advortiHO- 
ment following solid reading matUv tabulation waa imuie o£ the 
successive pages contaimng advertising matter, exclusive of cover 
pages. Results are shown in Table L 


TABLE t. 


HIIOWINO TJIE PnEclt-JiKCi' iV^ITU WHICn lUGiri' AND I.RFT-ll 
I'AfilOS CAmt\ advkrtiskmknts in the AMEUK.'AN 
MAGAZINE and ’HIE SATIUIDAV EYENJN(i 
rOWT FOR 


\ND- 


Total Total Total 

Right Left Total 
No. % No. % 

Amer. 670 60 606 44 1Q&2 

S. E. P. 621 52 4B1 48 lOOO 


Full Full Full 

Bight Left Total 

No, % No, % No, 

301 82 64 18 365 

35D 07 171 33 521 


if '100 AtlvertlsluE ana Ite MciRivl r.ivWB, New York, MftcmUlnn, 

U, HoLchTdsB and R. 0. Frur.ko.i, AltenCIon ViUiifl of AilvertlHPTiioiiLH,. 
New ‘XoTk V'nWorBky, mi), p. 21. 
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These figures show that in both magazines the right-hand page 
Is used for advertisements more frequently than the left; in the 
American 6G per cent of the times and in the Saturday Evening 
Post 52 per cent of the tiines; with a frequency on the aver¬ 
age 17 per cent greater than that for the left-hand page. 

sun stronger evidence of the favor in which the right-hand’page 
is liehl conies from facts shown in a separate tabulation which 
was jnado concerning the location of full page advertisements. 
There were 305 of these in the American Magazine and 521 in 
the Saturday Evening Post. Eighty-two per cunt of the former 
and G7 per cent of the latter appeared on the vight-hand page. In 
tiic first named periodical the right-hand page was used for full 
page adverLiseiiients five times us frequently as the left, and in 
the Saturday Evening Post twice ns frequently* It was observed 
Lliat certain advorti-sers who consistently used the same relative 
position in issue after issue ulmost invariably used the right-hand 
page. 

On the assumption of the historical method, that a practice 
much in vogue has probably jirovcd itself profitable, it would ap¬ 
pear from IhcHe results that the right-hand page in magazines is 
more pro fi La bio Llian the left. True, the practice here revealed 
need not ncce.ssarily be considered as having been })ased upon 
conscious reckoning of comparative profits and losses from right 
and left-hand i user Liu us* Even at best it probably represents only 
Llio fruits of a "sub-conscious'* "hunch." Never the los.s it is com¬ 
ing to he recognized that such a process of summing up experience 
has some validity ns n guide in business practice where scien¬ 
tifically valid mensiircs arc not yet obtainable. 

Appear unco on the right or left-hand page of a magazine should, 
however, not he connidered as wholly a result of the voluntary 
choice of Lho mlvertiser. Retpiirements of journalisUc nial<e-up 
would inevitably ])iit some ad vlm'L ise men La on the right and some 
on Lhc left-hand page. Again, the rcquivcmeiits of color process 
or of some other technical in a tier might force certain advertise¬ 
ments on one page rather than another. Moreover, some adver¬ 
tisers do not specify eithev page, not regarding the matter ns im¬ 
port an I enough to bother with. For these reasons the more fre¬ 
quent use of the right-hand page can not be regarded as purely a 
rcficcLion of profilnblc experience. Still these factors alone might 
be expected to work toward an equal distribution of advertisements 
upon the right and lel't-hand pages. The fact that they are nn^ 
equally distributed indicates that some selective factor is at work 
in favor of the right-hand page. And the fact that this page is 
used will] overwhelming frequency by the purcha.sei'.s of the ex¬ 
pensive full page advertisements indicates that the right-liund 
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pji&e hna demoTistTated its superiority to at loa4»t Home influential 
and successful advertisers. On slighter evidence Hum this apace- 
sellers have set “preferred-position" prices. 

X. Position on NEWsrAruir Pacii- 

In answer to the aueation, what is the bost portion of a news¬ 
paper page for an advertiaementi rccommeiKlalioii.s Jmve been 
made as follows; the upper half, the right-hand poutiou, upper 
left-hand corner, upper right-huTid corner. Or, in recognition of 
the need for considering the right and Ictt-hanil pagert separately; 
the statement has been made that the upper outside corner is 
preferable.* These conclusions have been renched chio/ly from 
laboratory iuvestigationa in which the subjects have been shown 
a "dummy" or a real newspaper or mtignvine contuiniug advev- 
tisements or nonsense syllables distributed among the various por¬ 
tions of each page, and have been asked inter to write down those 
items which they have remembered. The positions of those items 
mentioned the greatest numbers of times have been judged to be 
the most favorable. It should be noted that the concliinioiis re¬ 
garding favor ability of positions arc fov the most part based upon 
studies made with magaiinea. There is cousidevahlc doubt 
whether conclusions reached regarding posiLion.s in mngazinoK arc 
true also for newspapers. 

Regardless of the advunfcagcousness of these particular positions 
on a newspaper page it may be seen from even a cursory exami¬ 
nation oi the best type of newspaper that they arc not ciiualiy 
open to the use of advertising matter. For there is « practice of 
newspaper luake-up that crowds advertisements into certain por¬ 
tions of the page in order to reserve certain other portions for 
news. A circumstance which presents grave obstncics to the use 
of the pesUiona which have been so laboriously designated ns ad- 
yantageous. 

Specificolly described^ the practice of newspaper makc-up; tech¬ 
nically called "pyramiding/' is to block up the advertisements first 
from the lower right-hand corner of the page. On some pages 
(usually the second page of the newspaper) only a small portion 
•of this corner Is used. But as an increasingly larger portion of 
the page (towards the middle and latter half of the paper) is 
consigned to advertisements the advertisements begin to run up¬ 
ward and leftward until often only a small portion of the upper 
left-hand corner is left for news. But this corner is usually thug 

^AdeimB, on. clt. D, 101. 

HotchklBB and Prankon, op. ctt. pp. 23-25. 

108-115^Scott I^’oreaman and Co, loU* Clilcago, pp. 
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veserved (unless the entire page is devoted to advertisements). 
Here is an apparent block to effective newspaper advertising, at 
least to that theoretically recommended by laboratory investig¬ 
ators. 

In order to measure this block ami expresg it in quantitative 
tenna the writers undertook ah investigation of actual journalistic 
practice. Choosing a newspaper that admittedly represents a high 
standard of jouriialistic mako-up and advertising value, they tab¬ 
ulated the number of times the different quarters of pages were 
occupied by udvertisemonts, and from this calculated the chances 
that an advertiser might secure a “favored*' place for his adver- 
tisement. 

The New York Times was used, and 1000 successive pages bear¬ 
ing advertisements and news were chosen from the issue of May, 
June and July, 1922. Those pages were omitted which contained 
nothing but advertisements, also those containing classified adver¬ 
tisements. Notation was made in each case as to whether or not 
the particular portion (half or quarter) contained any advertis¬ 
ing matter, be it ever so small. Results are shown in Table I, 
and Figure 1. 


TABLE L 


SlIOWINO TJIIO NIJMHKU ANH PICK CMNT OV UPPKn AND LOWIAR, 
KUiHT and mo ft pout 10 ns op lilOFT AND III GUT HAND 
PAGIOS OCOOPtlOU liV ADVIOl(TIHIOM10NT« IN TIIIO 
NIOW VOHK TIMIOS DU KING MAY, JUNIO 
AND JUIA*. 1U2!2. 


oon liCft UiinO PilijOH 
Lowiir lIuH Upljur IIjiU 


Loft UiKlu 

t)\mrU‘r OpiirU^r 
No. Vt 

175 yr> ;iu(> 77 


Loft' UlgliL 

0\uvrlt*r (puvTlL'C 
No. Vo No. Vo 
150 50 570 75 


m nieht Uuna Pnges 
Lower Hair ODpar Hnlf 

Lt-fL lUght LeCL Illglit 

Clviiirter (-luftvlttr quarter Quarter 
No. Vo No. Vo % -OM % ‘ON 

iir> lia 335 iir> 23 203 00 


Left hand pago Right hand page 


30 

73 

23 

60 

35 

77 

23 

68 


Fig. 1. Slujwiiig the per cent of pages on which the various 
qiiiirteiH were occupied by advertising matter. 
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i. Left and Riffkt-hand Pages, 

Of the one thousand pages examined, (505 were on tlie left-hand 
page and 495 on the right-hand page. (It is interesting to note in 
this connection that full-page advertisements, whieh )ui<i been lub- 
alated incidentally but nob counted nmoiig the llionsund siiown in 
the table, appeared more frequently on the vight-Uund pivi^e. Of n 
total of 235 fuU-pag<i advertisements, 120 or 53 per eent were on 
the right-hand page.) 
jg. Lower half, 

a. Left-hand page. On the 505 left-hand pages tlio lower left 
quarter was occupied by advettisements in 175 ov lln per cent of 
the cases; the lower right qiiarlcv, in 300 or 77 per cent of the 
coses, 

b. Riyki-hand page. On the 495 rigUUhiuul jmj^cs the lower 
left quarter was occupied by advertisements in 115 ur 2li per cent 
of the cases; the lower right quarter, in 335 or GB per cent of the 
cases, 

3, Upper half, 

a, Le/t-/iand pope. On the 505 left-hand pages t!m i\iq)ev left 
quarter was'occupied by advertisements in 115 or 2‘3 piir cent of 
the cases; the upper right quarter, in 295 or GO por cent of the 
cases. 

Z>. Right-hand page. On the 495 right-hand pngc.H tho upper 
left quarter was occupied by advertisements in 155 or 23 per con I 
of the cases; the upper right quarter, in 295 or GO por cent of 
the cases. 

COM CLU SION S. 

Those results show that regardless of the alleged superiovity of 
certain positions in newspapers, there are pronounced liniitnLions 
to the likelihood that these positions may be secured. Thus al¬ 
though the right-hand page may be more desirable, it will he open 
for advertisers no more frequently than the left, since these results 
show it to be occupied only 496 times in 1000. 

The upper outside quarter, which is recommended a,s being most 
valuable of all can be secured only 30 times in 100 on the left-hand 
page, though,' fortunately it can be secured 60 times in 100 on the 
right-hand page. (For the sake of easier visualization, tlie fre¬ 
quency with which the various quarters of left ivnd right-hand 
pages are used ia shown diagrnmatically in Figure 1.) 

The right-hand side of both pages is twice and even three times 
ns likely to carry advertisements as the left-hand side. Which 
means that in the case of the left-hand page the majority of ad¬ 
vertisements are going to be oii the inside. And, unfortunately 
for the advertisers, this tendency is more marked in the ca.se of 
.the left-hand page than in the case of the right. Those amounts 
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may not hold good for all ncwspnpera, cspcciolly for papors uainc 
the pyramid syatem more thoroughly than the New York Times 
With such i.npera it is likely that the percentage of pages carrvinrr 
advertisements in the upper left-hand corner would bo still smaller 

From a journalistic point of view this quantitative investigation 
of the practice of jiyrnniiding shows that the pyrnmUling pro¬ 
gresses nuich more rapidly upward than leftward, the upper rlctht 
portion of the page being occupied almost ns frequently as the 
lower right portion. Tliougli it should be remarked that the ad 
vcrtiscnients did not u.siuilly occupy the entire upper right nuar 
ter; t.ibulaLion wa.s made if an advertisement merely extended 
into tliu 

While this invofltignLion furnishes no li^rhL concerning- the rcla- 
tive value.s of the various.po.sitions on the ncw.spaper page it 
sliows that there arc distinct limitations to the ease with which 
certain po.sitions can he secured, and it sliows, at least for one 
high-griule nowspiiiicr, the siise of the limitations in quantitative 
terms. It also .suggests that Llie findings of laboratory studies re¬ 
garding many other problems of advertising might profitably be 
checked up with actual eoiiditions in order to show the practica¬ 
bility of their aiiplieiition in concrete situations. 



AK EXPERIMENT IN TESTING ENGINE LATHE 
APTITUDE^ 


By Everett F. Pattbn 
University of Wisconsin. 


The invcBtigation reported in this paper wfis carried out in 
co-operation with the Shop Prnc-tice Deportment of the Collego of 
Engineering, University of Wisconsin. It was able to profit ma¬ 
terially by a preliminary investigation made along the same lines 
in 1£)21.- It was also favored by the fact that in the Shop Prac¬ 
tice Coarse there were many students turning out supposedly 
identical pieces of work on fairly aUnilar lathes. There was an 
added advantage in the fact that the men directing the work in 
the shop were university trained, and consequently wore able to 
give such aid that the preliminary psychological analysis of the 
job was made more readily than would probably bo the case in 
industry. 

The particular type of work investigated was (i course iu ele¬ 
mentary lathe practice. This involved four hours of shop work 
every week and two hours of instruction every two weeks. The 
Btudents, following a combination of oral and printed instructions 
together with blueprints, turned out five pieces on nn engine lathe 
during the semester, These were: a worm, n worni-wlicol blank, a 
bevel-gear blank, a spiral-gear blank, and a planer bolt. The first 
four were turned out of cast iron and the Inst from rod sfctJel. 

The criterion of this investigation was the amount of .skill de¬ 
veloped in one semester of instruction. More specifienUy, the 
criterion was the quality of lathe work produced by the students 
during the course. Instructors' estimates arc notoriously unre¬ 
liable, as was found by the ptcUminavy investigation und should 
never be used if an objective criterion can be obtained. Fortun¬ 
ately in this case the pieces themselves could be inenyurccl and ft 
thoroughly objective criterion thus found in the accuracy with 
which these pieces correspond to the blueprint specificiition.s, Work¬ 
ing with great care Mr. Brecky of the Shop PrncLice Department 
took thirty-three itiicroinetcr measurements on the fwc piece a pro¬ 
duced by each man measuring the various important dimensions 

^Prem the PsyehDioeical I/aboratary, University of WlHOonslii. Unilofiil 
(tckntJwledKUmit Is Uev^hy mtvrtc to Prof. Clnrk L. lUill, DeiJlirlnuMa of 
rsycliplogy. and to Prof. \V, L, Dabucy, Ulroclflt oC MncUlue Pvtudlvr. ProC. 
Hull Imu auporvlaed tli'j Invcstlpatloii nnci given imicli liolpfiil rrltlrlhin, 
Gspec^nny in tlie preparation of the m aims crip t. Prof. Daliuey Uiih given 
hGftXty CO •operation ami been ol great Usui stance p/irUciiliirly in nroriiriiiH 
sublccta ninl lu petfectlag some of tUe tests. 

=^Tlils Invostlgddou wfta reported In n muBtcr's tlvcals by 1 ). W. Nelson. It 
is on file 111 i]t& Hbrarr, rnlvorslty of Wlacanaiu, 
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o£ thesG p\etes, Several tl\o\isawl verv aceMTSYte Teadings vteve 
thus obtained. In addition the general finish of each piece was 
scored on a percentage basis. 

The measurements obtained were reduced to percentage grades. 
Tlie deviation of each measurement from the dimension colled for 
in the blueprint was first found. A check distribution was then 
made for each of the Lhirty-thrce moa3urement.s each distribution 
containing the deviations of all the men on that measurement- The 
median of each distribution was assigned the value of SB, the 
average grade given by the Shop Practice Department. The in¬ 
tervals of the distribution between the median and jsero deviations 
were assigned values between SB and 100 according to the size 
of the deviation- The fourth check from the opposite end of the 
distribution was assigned the value of 70 which is hardly passing 
on the school scale. The intervals of the distribution between this 
point and the inediun were aasjgiicd values between 70 and 85, 
The last three checks of the distribution wore given below 70 or 
failure- Thus tlie larger the deviation from the standard the 
smaller would be the percentage grnde. The mean of the grades 
for each individual piece was found and the average of the mean 
grade.s of tiic five pieces belonging to one man was computed in 
order to get his final grade in lathe working ability- AltbougW 
this process took weck.s of work the resulting criterion was very 
reliable. Indeed the large cuelTicient of total correlation (R) ob^ 
tainecl Inter was probably duo in no small degree to the care taken 
in obtaiiiing the criterion. 

In proceeding to find tests which would measure lathe ability it 
wna first found iioces.sary to annlyr.c that ability ns far ad possible. 
This was done by watching the men at work observing particu- 
Inrly wherein the good ones illiYevcd from the poor onea. As a 
result of this analysis eight LesUs were selected. Some of these 
at first glance would seem to have little connection with lathe 
ability in general, but they were included because they were thought 
to tost II consLitiient factor. In selecting the tests an especial eiTort 
was made to gel tests as dissimilar as iiossible so that thex^e would 
be little duplicntion. The detailed analysis will be given with the 
discussion of the various tests. 

(A) While studying the men at work it was noticed that the 
worker must be able Lo cstimnLe two diniension space and to co^ 
ordinate Uie motions of his two hands, lie must also be quick 
and sure of nn>vcniciiL. In order to lost these ahililies the “co-or- 
diniilion machine" wa.s devi.sijd.' The apparatus is shown in Fig. 

I'nr Mil'll ri nuir lij rn' wji.'i fh'M liv 1>r‘. It nil, who ^v'orkiuJ nul 

IlH Ki'iMTJil 'I'tn’ iMJK’lliJil ili-i.ilJ‘i itl rnJiHC nicMiiii wen* worlu'd 

(lilt hy rnif, Uiilnii',v lie (l»-H'i^riii-il jnnl rn.iili' a luiinlier of Improved 

itunlelH, 
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1. It may be heat thought o£ aa a compound lutfic 'Vest" nttnchcd 



to ft board. The tvctioft of the mnchine depended on two rcvcv/s 
placed at right angles to each otlier. Turning t)ie55(? scrowfl hv 
means of small evanks caused a cavviage to move in any desired 
direction in a horizontal plane. A long trncer nnn wns ra.‘>tonG{I 
fivmly to the carriage. Projecting down from the middle of the 
arm waa a small brass point* This touched the .surface of a hard 
rubber plate which was fastened to the board near the main part 
of the machine. Embedded in the plate .so Hint their lojis were 
flush with the surface were six brass pega arranged in a three* 
inch hexQgon. These pegs were connected by nii olccLric wire so 
that when the tracer point touched one of them ii huzzor sounded. 
The object of the test wna to start on signal from a certain point 
and make the circuit of the a^x brass spots as quickly u.s posMiblo, 
The time taken to go around was measured by a stop-wateb. A 
correlation of this with the criterion gave a-,42a. This was the 
largest and most valuable correlation obtained. 

(B) Another measure was taken of this test, that of distance 
traveled, The tracer arm extended out beyond the contact point 
and bad a pencil fastened to its extremity. This traced an exact 
record of the circular path on a piece of paper inserted for the 
purpose, A typical record is shown in Fig, 2, The distance 
traversed by this rather meandering line was measured by a 
specially devised instrument. The frame supporting the works of 
an ordinary watch was filed so as to expose the genr wheel on the 
shaft of the small second hand. The hands of the svatch remainGcl 
intact. The frame was so held in the hand of the measurer that 
the teeth of this gear could be run around the’pencil tracing, fol¬ 
lowing in detail all its turns* The distance traversed by this wheel 
was shown by the hands of the watch and could be read oft’ at a 
glance. It will be seen that the circular distance was nnon.surecl in 
units of revolutions of the small hand» One minute (or one rovolu- 
tioTv) was equal in length to 29*5 millimeters. The correlnlion of 
this measure with tho criterion was +.192. This was rather sur- 
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prisin" since it nuuint that the ^renter the distance, the better 
the (jrnclo on shop work. However, it was included in the final 
team of tests, 



(C) A third Kcore was iihjo secured by the inse of the co-ordi¬ 
nation uppiwalus descril)ed above. It was obscvvoLl that the 
worker niu.st friMjuonlly cut a true surface in a dingonnl direction 
usii^g his eye to guide him. Accordingly the subject was required 
to run the triicer diagonally across between two of the most dis¬ 
tant pegs going as quickly as possible. Here, as before, the time 
was taken witli a stop-watch. The correlation of this rnenaure 
with the criterion gave - .‘Ifd). This was large but since it was 
tlioiigliL Lliat it w(nild tin plicate the first measure tnlccn, that of 
time on the circular distance, measure C was discarded. 

(D) The .'iccoiid inea.sure of Lhe diagonal co-ordination wns 
made in deviations from a straight line between the two pegs. If 
Jl subject traced a .straight line lii.s record wouhl coincide with 
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the diagonal and there would he no deviation, riowever, if he 
wavered and made wrong movea, liis record Avouid deviate con¬ 
siderably from the straight line diKtiinco and Avould be poor in 
proportion to the amount of deviation- This deviiitioii was mens- 
urecl by the area of surface included between Uic record tracing 
and the true diagonal as shown by « straight line drawn hetwocn 
the points. This was niensmed by nieniis of a planiinetev- The 
correlation of this measure and the criterion wna - .O.'M. Tiiis was 
so small as to be worthless. If the instructioiiH had bean to trace 
as straight a line as possible this might easily have provcMX u val¬ 
uable test, It seems to have distinct possibilities, 

It will bo noted that the co-ordinntioii fce.st described above 19 n 
form of miniature test, It attempted as is usual in such cases to 
incorporate in a single test ns many of the vorlous elements neces¬ 
sary for success on the job and in as nearly the right proportions, 
as possible. Being a miniature it was portable and easily handled. 
One delect of the test is that it is undoubtedly innueiiced by train¬ 
ing and thus is not a pure aptitude test. 

(E&F) Further analysis of the job showed the necessity for 
close co-ordination betAveen hand and eye ns well ns for tjuicknes& 
and accuracy of movement. Accordingly the number checking test 
Avas introduced. This was. the standard 'WoodworUi and Wells 
number checking test in which the subject was star led on signal 
and told to cross out all groups of digits contniniiig both 4 nnd 7, 
He was given one minute. The correlation of the number of right 
groups checked with the criterion A\^ns H-.055, This wn.s Loo low 
to be of USE so Avns discarded from the finnl tcnin of tests, The 
number of groups wrongly checked -correlated -.036 so it waa also 
discarded. 

(G) It waa believed that the possession of mechnnicnl ingen¬ 
uity Avould be important for auccesa in lathe working so an elTort 
waa made to teat for this quality. Accordingly an adaptation of 
Stenquist's lock assembly test was used. The lock was simple and 
inexpensive. It consisted of six parts Avhich were: n rectangular 
lower case or plate, a dog, a spring, a bolt, a screw and an upper 
plate, The subject was shown a similar lock Avhich avos already 
assembled, and told to pul the parts of the other lock together 
like it, Although the lock seemed very simple, many had great 
difficulty in assembling it. Four failed entirely giving up after 
working from eleven to twenty-one minutes. The correlation 
Avith the criterion was -.199. Although not very high (-33 
was obtained last year) it hud such a Ioav corroJaLiou with the 
othei tests that it was kept in the flnal team as tapping a real 
constituent of the particular aptitude under consideration. 
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(H) The abilily U> foHow pvinU'rl (broL-UoihS fina blueprints 
ia obviously a farlor in iuarniuf^ luLhe work. To measuvo ibis 
ability anil to o:nin kiio\vlc(l|r(} of the aubjeet’s enrofulrioss and 
pairiHLakiiiK traits, n box-direetions test was iiilrorhicod. This 
lest ia ilic well-known Ilejily r>i*/.zle ))ox, coii.sistiii|r of a small 
lilnck cabinet rnnlninitiK a lock inecluniism worked by throe levers 
at the top mul left aulei! uf llu* box. The object of the test is 
to open this ilnor. The necessary steps in the process were 
printed on a lni‘)?e card hearing an exccdlent diagram of the box. 
This was before the subj(*ct as he w'oriced. Tins Lest proved 
even more dilVicnlt than the lock lest. Ten men did not open the 
box at all, some up with the hr si failure. The correlation 

of the time with tin* erilerion was -.270. 7’his was l^r^^e enough 
to warrant its u>e in the iinal team of tests. 

(f) The iiiiniber of wroiif; moves made was another measure 
taken on this lest, Ib)wev<'r, Lliis measure undoubtedly did not 
introduce any new elcineiil because errors caused the su)>jecL to 
.start over again and lb vis increased his time. In addition the 
covrelatiun was low ( .112) so this measure was elimiiuiLod. 

(J) In doinji: good lathe work a gnuit deal depends on the 

.skill (if the ojauaLor in tJikiriif accurate^ nieasureinifULs. Accord¬ 
ingly the eyiinder irauiriiiK test w/is iriU’oiluci'd. A series of nine 
brass cylinders was very (uirefnlly niad(* under Prtff, Dabney’s 
direction. These nnunmved .'hVd", .IMb", .bllO", .my\ 

and It will be semi Unit tlien; wi‘ru three (^conp.s 

each coinposi'd of three eylinder.'i, Kacli group or serie.s was grad¬ 
uated hy a different eojisiant the sjiriu* C(jiisLarit being u.sed 
LliroiigbouL a single jrnnip. The finest sm'ics ehaiiged by .steps 
of the next by and Lbe coarsest l>>^.biy". The sub¬ 

ject was givi'U a six-iiieli luachinisL’s rule, and a pair of calipers 
ami told to lind the cylinder.s wliieb nieasiire .il(»r>'‘' and ,8fl5" a.s 
quickly as pmeuble. Tin* tii»ie taken to find the two cylinder.s 
constitiit(‘d out* numsure. This cnrrelaU'd -.127 with Die criterion 
and was too Imv L(j lie of valm*. 

(K) Another -scori^ on the cylinder test was the amount the 
cho.sen cylinder deviated ni iiiea.suremeiil from the one asked for. 
Thus if the subject chose the .PJUP' cylinder in place of the 

liG was given a deviate score of .bdo. If he thought tlie 
cylinder inea.sured .8H.V\ be setired .(JIT). The sum of these errors 
gave his devi/ilitui senia*. as 'riiia measure correlalial 

with till* criterion, 'I’Ih.s si'cnieil suflieienLly higli to be (/f use but 
it was finally diu'ided to eliminate tlie ti-nf from the final team 
hccau.se it was rewilly a trades Lest nieiisuring aniuired skill rather 
than apUUnh*. 
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(L) An effort was made to test inffcnuity mid reji.soniiip ability 
by the Tnatch-squaroa test, though nt the oulsot there acemed but 
fl gambling chance of success. The mfttcli-.sf|uaics test consistod 
of seventeen matches glued to a. boarcl in siieh fi wsiy ns to inakc 
six squares in two banka of three each. Tim subject was abown 
these squares then given a mimeograpbed fjlicet on which short 
jines were drawn to represent the matchns in the sniua position 
as on the hoard. He was toki to cross out fivo of Llio abort lincH 
in such a way that if they were removed there w’oiild bo left 
exactly three whole squares and no lines left (?vei\ The time 
was taken with a stop-watch. Wlton through, the .subject was 
naked whether he had ever done this or a similar invAvAa before, 
The fact that many were nlrendy faniilinr with it togolhor with 
the additional f&ct that twenty-two out of the sixty subjects could 
not do it at all seems to have destroyed whut littlu diuKiiostic value 
the test -may have had. The correlation with the criterion was 
only +.164. This was too small uiul also in the ilivectinn cou- 
U’Skvy would hPiVe been exii<icted the test wan diKcardeclx 

(M) In watching the men at work it aeeiped probable that 
a keen sense of space vclationabip was iiccesj^ary, pnrticuhivly 
in guiding the cutting tool to its place find in hucliiig c^jnlcvs. Ac¬ 
cordingly the circle centering test was devised* A sheet of paper 
bearing a number of mimeographed circles, (see PiR. ii) was put 
before the subject. He was given n pencil mid asked to niidco n 
dot in the center of each circle ns quickly and acciirnUOy an pos¬ 
sible. The task was complicated Bomcwhnt by the overlapping 
of some of the circles. The time required to plncc these doln wa.'i 
taken by a stop-watch and constituted one measure. This corre¬ 
lated -.201 with the criterion and since U was quickly and easily 
taken. Since the teat was so cheap and portable it was kept 
in the final team of teats. 

(N) Another measure was taken from this teat the errors in 
locating the centers. These deviations from the bvu<i centers 
were meusured translated into grades by a rnthor complicuted 
proeesa and these grades averaged to get the final grtido for each 
man. Since this measure was not used the process will not be 
discussed further. The correlation with the criterion was fairly 
high (-.278) but was in a direction contrnry to what was ex¬ 
pected, Apparently the good subjects sacrificed accuracy to speed. 
Paifcly because of this, and partly because of the labor in acoj’ing, 
this test was not included in the final team. 

(O) It seemed rca^ouahle to believe that if a mau were skillful 
in handling woodworking tools he wordd also lend to be nu adept 
in u.^ing other kinds, such ns arc employed in lathe work, Fol- 
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lowiiii this line oi reasamng the woadworkinK test * was given. 
The subject was asked to saw a three-inch .square from a small 
board of definite size and shape, bcinj? given a r.aw. a square, a 
pencil and a special device for holding the wood ,siJcli na is in 
common use in manual training sliop.s. He wan timed by means 
of n stop-watch. This measiirc had the surprisingly Jow correla¬ 
tion of -.119 with the criterion. It was discarded. 

(P&Q) Two other measures wore taken from the wooflwork- 
ing test one in deviation in dimensions from the tlircM'^inch square 
and the other in deviation.? from the true right jmgles. Those 
latter measures were very dilTicult to make, requiring horns of 
almost microscopic work with a vernier rule, a .square and n 
rule calibrated to one hundredths inch. The correlations in both 
cases were low, being -.095 and +.076 respectively. Ilotli mons- 
urea were discarded- It was a source of .some surprise that the 
woodworking test did not have more dingnustic value. 

The instructions lor each test were given according to an un- 
'varying formula so that the results would he as comparable: as 
possible. The tests'were given in a quiet room in a dorndte se¬ 
quence. When the subject was admitted he went in regular suc¬ 
cession from one teat to the n.ext» showing a card containing his 
name and number tu each tester. By such devices a eoiist.'int 
stream of subjects was kept /lowing smoothly through the testing 
room. In order to obtain useful rcaults, it wa.s thought tie,?!ruble 
to Use u minimum of sixty records. Consequently over seventy 
men were tested so os to allow for the lo.ss of ten through de¬ 
fective records from various causes, 

A summary table of the correlations nircncly given i.s as fol¬ 
lows; 


TABLE 1 


1 ' 

*(A) Criterion with co-ordination tost, time -.423 

^(B) Criterion with co-ordination test, distance -1-.192 

(C) Criterion with co-OYdma.tion test, diagonal lime -.350 

(D) Criterion with co-ordination test, diagonal deviation -.034 

(E) Criterion with number checking, rights +.050 

(E) Criterion with number checkig, wrongs -.035 

'*‘(0) Criterion with lock test, time -.199 

*(H) Criterion with box test, time -.270 

( I) Criterion with box test, errors -.112 

(J) Criterion with cylinder gauging, time -.127 

(X) Criterion with cylinder gauging, deviations -.lUG 


‘The woodworklni: test \ym UoviHcd iiv Mr 1^' 
PBycUology Deportment, University ot WI«cbiiH.n 


Mueller of lUe 
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TABLE l^conL 


(L) Criterion with mutch squnre, time -|-.1(>4 

^(M) Criterion with circle centerinK^, time -.201 

(N) Criterion with circle centering, grades -,273 

(O) Criterion with woodworking, Lime -.119 

(P) Criterion with woodworking, dcviotions in dimemnons -.005 

(Q) Criterion with woodworking, deviations in nngles +.076 

The variables finally used were renumbered for convenience: 
Criterion =1 

Co-ordination, distance =2 

Co-ordination, Lime —3 

Lock tost, time =4 

Box test, time —5 

Circle centering, time =6 


The mean.s and standard deviations of these variables are shown 
In Table II. 

TABLE II- 

/1/caufl. t^luiidard Deviaiwus. Unit of Measurement. 

Ml—84,046 S.D.i—3,089 Percentage grade on wnrk pieces 

Mj= G.940G K.D.r-" .2003 Minutcs-diatance** 

M,= .9250 .:i8G0 Minutes 

Mir-^ 0.8585 S.l').,--5.089 Minutes 

M,== 4.78 S.I).:^-2.G27 Minutes 

M,= .3705 S.D.n-- .2547 Minutes 

The zero order correlaLiun.i and intcrcorrelations arc shown in 
Table III. 

TABLE in. 

rn=-|-.192 


ri3^ ^.423 

r»^ -.229 



r,i= -.199 

r.,-=-|-.142 

r„-~+.050 


-.270 

!’:.- + .118 

r..r.-r+.03C i^,=^+.l03 


r.c— —,201 

r..a^---+.022 

iVc^+.170 -032 

I'aa— + .0.^9 

The P. E 

. of each of 

the correlations in the 

first coluin 


roughly ,08. 

It will be noted that although the correlations with tJic criterion 
are fairly high, the intercorrelatioiis are exceptionally low. More 
than usual stress was laid on the latter in this investigation be¬ 
cause it was thought that this principle is generally observed too 
little. To get the undiluted corrclalions with the infiuence of the 
other tests removed, the zero order eorrclutions were subjected to 

llir tt'HlH M'lilcli won' liK'lUili'd in LLio llnal U'liin. Tlu> atxivo f'h 
ivcri' uU itroiliii'l-tiMJim'iH rnidllfU'iHH 

*’fU.4liiTico In lormn of clrcumfcrcncL* cf Bcnni on second Imnd. 
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partial corretntion, using Yule's formuln* nni\ Ilosantnv’B' Rcnersll 
technique. 


r r 7«r 
12 13 23 • 



There were some fifiy-Uvo of Ihuac i>nvUnlrt. Only those of 
highest order rvc given in ThIiIc IV; 

TAl^UC IV 
Partin) correiaLions 

r 

U.2r»0= -.211 
ir».23^«:= -.'isn 

Thene partial correlations show but very little shvinkuKO and 
show that the experiment was unusually succewsful securing a set 
of tests liighly uncorrelated with each otlier. 

After the partial correlations were found, the coefllcivnt of total 
correlation was computocl- This coi'rclution of the cn'turioii with 
all the tests weighted in the best po.ssible manner, wns computed 
In two ways to check the arithmetic" The formulae were 



2 2 2 
l- (l-r ) <l-v 1 (l-r ) 

12 13.2 U. 2 a 


a 

a-r 

lCi.2a4 


2 

< Ur ) 

l<i .234(1 


12 2 2 2 2 

Rf= 1 1* i'l-r ) (1-r ) ll-r ) (l-r , ) (l-i* )' 

10 15.6 UM 13.460 12.3456 

One correlation was ,5549 and the other .5545 showing jUI the 
partials to be correct. This correlation is about as large ns seems 
possible to secure from such highly selected groups ns university 
students. It demoiisti: ates the possibility of detecting aptitude in 
duality of lathe work produced. 

In' order to got the maximuim yield froin ti team of tests as 
well ns to use a set of test scores to predict probable huccchs in 
a given vocation, a regression equation must bo obtnjiiod, The 

lixtroilucUou lo tli« TIu'ory oC StftUwikH. ii. 'iUU, 

^IluHniiow, AiialyislK uC Momal IHunitUm, \i. :iU-4il. 

'Itoyjiiiow, ua, clL, D. <0. 
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gcnerni form^ for Lhin cquulion for aix variables 
five Lcsta) is: 

KI) SD 

1.234fi6 

--— X 

3.12460 


1 

.23466 

J 

G 

*2 1 

13.2460 

SI) 


SD 

2 

.13466 


SI) 


SI) 

1 

,23406 

] 


3 


].23160 

•ir . —X r-> 

14.'^360 4^1- 16.2346 

SI) 

4,12306 6.12346 


(criterion and 


SI) 

1.23460 

'f --- X 

16.2346 a 

SI) 

G.12345 

Where Xr-* the deviation of any subject from the mean of thot 
variable (liore the criterion), where x,, x,, Xi, Xs, end x# eciual the' 
tlcvintion of any subject from the means of thii rospectivc varia¬ 
bles, and where S.l). etc., equal the partial standard devia¬ 

tions. The.^e iiartinl .standard deviations arc obtained by a formula 
of the type;' 


g.D, - s.D. f ' r n / 2 

1.23450 1 V 1-r l-r V l-r 

12 13.2 14.23 


S/ Ur" si 1-," 

15.234 IG.2345 

The partial nlandiird deviations arc shown in Tabic V: 

TABLE V. 

1,31154^^3.070 S ,D.i,iai:e=4.681 

S.Do.mi*=2.483 

b.D.i.ia4M^= .343 S-D.a.ian3= ,2'17 

Substitutiiifr these, toi^ether with the partial correlation cocfli' 
cient, in the formula for the rcf^res-sion equation and solving we 
have; 

Xi=2.307x3-3 .20 2Xj-.132xi’. 353x1-1.90 6x« 

Tins, however, is not a very convenient form of the regression 
equation for practical use. Substitutions were nccordin&ly made 

'Viilf, (i[i p, li 11, 

*Yuh', ‘*l>, vll,, p. 2;{7. 
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for the small x's bo that instead of deviations from nionns were 
had individual scores minus the mean of that variable 
(Xn-Mc. The formala then becomes: 

XrMi=2.397(Xz-M,)-3.252(Xi-M,)-.132(X,-]Vr*)-,303(Xi-M») 

4.99G(X«-Mfl) 


Substituting values for the various means (found in Table IH) 
riTid solving^ the following equation wna secured: 

Xi==73.635+2.397X^^3.252Xi-,ia2X4^.3D3Xi-l,907X. 

It will be noted that the values Xi to Xa represent gross scores 
ol any given subject on the present team of testa while Xi repre¬ 
sents his probable grade in a course such ns previously described, 
Now if a person of unknown aptitude in this kind of woric should 
bo given the above tests, his test scores might be substituted in 
the above equation and his most probable grade in aucli n course 
be predicted with some precision. To tuko an actual cu3g, subject 
number 9 made in this team of tests, the following scores: 

Co-ordination, dislanccr^G.G revolutions 
Co-ordination, timG=1.05 minutes 
Lock testzzil.n minutes 
Box tesb^a.S? minutes 
Circle centering, time:=:,3i) minutes 

Substituting these in the equation, the result is: 

X-73.636:=2,397(6,C)'3.252(1.05)-.132(U7)-Ln9C(.3r)) 

Solving, Xir=84.008, This man acUmlly scored S4 in his five 
pieces. 

To lighten the work of prediction, both for this investigation 
and for the one to be carried on with a new group of subjecla 
here next semester, a chart was prepared conUiining nil tlie 
products of the probable test scores and their respective weights. 
The scores were then predicted for all the sixty subjects, both to 
confirm' the R and to observe the detailed relation of individual 
predicted scores bo the actual scores. This is shown in detail in 
the scatter diagram, Fig. 4. 
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RACIAL DIFFERENCES AS MEASURED BY THE 
DOWNEY WILL-TEMPERAMENT TEST 


By John B. McFaddiin nnd J. F. DA8in::Li 


INTRODUCTION 


of character nnd personality traits is, by its very nntiiro, 
a perplcxir.g problem; since there arc a nuiltipHcHy of factors 
entcrmB into the make-up of any given ii^dividvuil, and since the 
erganiffation of these factors varies so greatly with ouch iniUviclunh 
Several tentative classificntiOTig of tlie traits nml of the fnetors 
governing the combinations of the traits linvc been ninde. Wood' 
worth* analyzes personality into four factors: Phynicpic, Clicnii(iuc 
or Temperament, Instincts, and Intelligence. l'\ U. and G. W. 
Allport* div'de tendencies into: Intolligence; Temperiimenl, iimUul- 
ing Emotional Breadth ami Emotional SlrongUi; Hclf-expaiision, 
including Exbro-Introversion, Ascendaiice-Siibnii.ssioii, Expansion- 
Reclusion, Compensniion, nnd In.siglit and Solf-Evjihiation; ami 
Sociality, includins Social Pavticipatiou; Self-Hocking luid 
Aggressive Self-seeking, and Susceptibility to Social >Stiinuli^ 
Tests for these were given, and the reanlLs checked by CsUmutoH 
of char net cr and personality given by friends of the subjcetfi 
tested. The above division of tendencies is coiiHiclered by the 
writers as merely a tentative ono which may bo of so?)ic iumc in 
^'uiding further character aitalyais. Watson^ Rivca a form for 
analysis of personality, and Wella' clnsaiflcs the hoaUUy mental 
reactiona as distinguished from unhealthy ones. 11. T. Moore uml 
A, R, Gilliland* studied nggresaiveness ns n personiUity LniiL, iso¬ 
lating it as far aa possible by selecting two groups of students, one 
composed of students rated as the most aggressive iii their chi.ss, 
and the otlier composed of students rated as the leant aggressive 
in their class. The following testa are suggested ns mon.surcinents 
of aggressiveness: eye inovementa; distraction fi'oni staring, from 
electrical shock, and from visual presentation of a snnkc; and a 
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word U‘M. In Uic aljuva the firsL scored 

higli, and the i,t.'rf*nd rrored lojis, lluis indicatinj; the value 

of tlic nu!tho(lH lined, ii. 0. FilU?r^ ,‘itiHned Jiidf-Assurnncc and 
Speed of Deciidiin, rnuchulinK that one teat was not sulllcieiit for 
each trait, hut that two or niru’c shuuld he K'Ven. Also, he con- 
chider. that there was not n vi-ry close corruliitioii hetween speed 
of decision and iadf-aKSiironcc'. The lost userl in the present 
study of rarial dllTi'i encea is llie Ihiwnoy WilhTeniperanvjiit Test' 
fornitilatc<l hy Jh*. K. Ihavney, of the University of tVyonKn;^. 

Tile pnrtiruljir puddem here rdudied is Iho c()ini>urifnn (jf tem- 
peranient as founii in iinlivnluala of the white and nep'io races, 
ri’oviinis sLndies have hi'i-n made regard ini? the comparative in- 
telli^^ence of the two race?i. Muyo* diids that, while the "data 
point:! clearly to a nn-asurahle degree of nieiital ililTorcncc,'’ the 
difl’oreiice.s are of di*j,n*<je, and not of kind, uml that mental variii- 
bdily is si ghtly less in negro high school sLudeuts than in white 
high school sLncIents- Fergusoir, using the Woodworth and Wells 
i\!ixtd Ui'liiliono Test:! 1 and II, ii form of the IChbinghaus Com- 
plelitai Te,Mt, a rniieellation Te.st, and one of the Columbia Mazo 
Tcsl:?, linds the* inU'llecUial p(‘rforinaiico of the general colored 
jopiilation (u he apprcxiinalely seventy-five per cent na erticient 
as Llial of whiles, with the possibility of negroes more nearly 
approaching whites in retisoiiing based upon concrete ohjecU than 
in naisoning haM'd upon nii'^ntal repres^mtationa of the objects. 
He (IikIh a ]>raclical iMpialiCy in sense capacity in the perceptive 
and fliscri mi native abiljLin:^, and, since Iho diiyerencc must exist in 
the cenlral elalnnativn powers upon which thought more divcctiy 
depc^iids, he inrors that aiieh neural difTerencas aa may be founri 
will |)r(dml>Iy lie mniiiiy in LIkj constitution of the cortical neurons, 
rather than elsewhere in the iKsrvous .system. This point will be 
taken up later, Ferguson also stales that, while no certain con¬ 
clusion as to rncinl variability can he reached, it would be reason- 
nhle to sn))))ose that the negroes would vary more than whites, 
since Lilt; 'aj-L'alled negro race is not nearly as homogeneous as the 
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white race. DerTick‘" finds that the ne^ro college student is older 
than the white, that their average intelligence quotient is nine 
points lower than the average v^hite intelligence quotientp and that 
the white college student is about seventy-seven per cent as vari¬ 
able as the negro college student. 

Turning from previous work on intelligence, and considering 
other studies of racial differences, we find several reports on dif¬ 
ferent traits, Stetson*' finds practically no difference in memory 
in the two races, though there may be some doubt as to the value 
of this contribution. Bache" finds the negro quicker in his reac¬ 
tion time than the white man, and Garth" finds that there are 
alight differences in their work curves—^that there is a tendency 
of the negros to do more of their work in the first half of the 
allotted time than for the white workers. This would indicate 
that the negroes are more quickly aroused to work, but that, after 
the first spurt, their effort diminishes. Mitchell, Hosanoff and 
Rosanoff''' in a study of association, find that negro children, on 
the whole, show further departure than white ones from the normal 
adult association standard. 

Before going on into our particular problem, it is necessary to 
note Borne cautions which experimental work has given. Pressey^'^ 
warns that grade norms may vary very greatly in various schools, 
that there may be different age distribution, and that other factors- 
may enter in. And, in a comparison of students of different racesp 
it is all the more important to bear this in mind, since grade norma 
will inevitably vary much more greatly in schools for different 
races than in different schools for students of the same race, 
Arlltt” finds a tendency for greater variation (in resulta from 
intelligence tests) in the same race but different social status than 
in the same social status but in different races. This latter point 
will be considered in the next section. Further, as Gatewood*^ 
points out, there is a tendency to rate negro children above their 
mental status, as compared with the tendency to rate whites at or 
below their true mental status. 


Di'i'i’icli, S. >1. .1 atmly of the InteUlf/cucc of Tl7L/tc aud Oulni'cil^ 
(7(il(€f/c ifitutenta. Joiivunl of Applied Psychology. Vol. 4, pn. 3lC-,S:iO, De- 
lO^o. • 

“ Stetson, C, n. i?owe Mcinory Teat a of Whitoa and Hiacfca. PsycliQl- 
Offlcid Key lew, Vol- 4, pp, iiSd-liSO, 1807. 

Hnche, It M. ue act ion Times 117 lieferencc 1o ]{ftce. Faycliologlcnl 
Review, Vol. 2, pp. -175-480, 1805. 

(larth 'l\ R. }Vhlte, IipHan a ltd Vcfyro Worlt Curuoa, Jouvnftl o£ 
AppUucl Pi^yeliology. Vol, 5, Ko. 1, Mueeh, lUtil. 

“ 51 Itch el I, J., llosiiiiolt, L U., nnd Ilosiinoff, A, .T. A fitudy of Aftsoci- 
01 ion til Scyt'u Childnn. Psycholo^rlL‘llI Review, Vol. ^0. Kcpu^niber, lUlP. 

IB s, I,, /j'jic jji-obicm of tlic L/Jiflclcclcfl In Ihe 87and* 

at'flUalion of I'esta. Joaniiil of Applied Psychology, Vol. ,5, No. 1, Miireli, llllij. 

Arlllt, A. IK On the jfectl foy Ounti<ni in J-Julahifahiny Jtaoc j\oi ms- 
Jo Ill'll III of Applied J'sycliology, A^ol. il, Nn. |, Miu-ch, 1{V21. 

(htteNYoort, E. K. Tfiif herii' KsHmok-a uf ^tcfjrucs and 1V?i|tc,s. ,*^011001 
mid Society, Vol. U. pp. 00-01, 1019. 
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SUBJECTS AND TESTS 

The subjects tested were white and negro high school and college 
students. U was hoped, by choosing such groups, to eliminate 
many of the factors of .selection, and to make the groups more 
directly comparable, and also lo fix a gonenil level of intoUigence* 
between the groups. It was found, Jiowovcr, that, in general, 
negro students of each gr*ade wove slightly older than white atu- 
dents of the same grade, This is constantly found in coinparisonB 
of white and negro students. Graphs and tables follow, which 
endeavor to analyze the general results, and to interpret them in 
terms of equal ages and equal grades. Those vesnltB arc based 
upon the records of 38 high school and 39 college students from 
each race. 

The thirty-eight white high school students were tested at the 
Chapel Hill High School, and were choacn at random, nearly all 
of the male atLule 2 its being taken- A note should be made here 
concerning tlie juakc-up of this higJi school, since it is a little out 
of the ordinary. The high school students are drawn from three 
fairly distinct’social classes; those from the surrounding farm 
Rud mill districts, those whose parents are in business in the town 
of Chapel Hill, and those whoso parents are members of the 
Faculty of the University of North Carolina, A survey of gen¬ 
eral intelligence of those students with regard to tlieir respective 
social classes was made in 3 917 by Chase and Carpenter and again 
in 1921 by Dashiell and Glenn, who found that the social levels 
and intelligence levels were sti-ongly related. As might bo ex¬ 
pected, the Faculty children led in geuernl intelligence, followed 
by the Town children, with the Out-of-Town group la.st. Chapel 
Hill High School embraces the 8th, 9th, 10th, and 11th grades, 
with seven years of grammar school work preparatory. 

The thirty-nine white college students were taken from classes 
in psychology nt the University, the entire class in Abnormal 
Psychology being tested, and the balance volunteering from intro¬ 
ductory classes. Except for the very few freshmen and seniors, it' 
is a fairly typical group of colIogG students. 

For the negro subjects, students in three negro institutions were 
tested. The National Training School, at Durham, N. C., fur^ 
nished five college students and all except two of the higli school 
studeists. There is some doubt as to the ViiUdity of all the results 
from this group, since the testing was stopped, after forty sub^ 
jecLs had been secured, upon evidence that some of the students 
were being coached by their fellows. This would naturally alTcct 
the Reaction to Contradiction tost, ami it seemed to iiiTect the 
Motor Inhibition and Co-ordination of Impulses tests, since there 
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waa an unnabm’al tendency for the subjects to write exceggivdy 
slowly in the preliminary warming-up (Teat II, 3), and, for the 
Co-ordination of Impulses, to take great pains in adhering to the 
space limitations, but to fail in the time limitations. These 
tendencies were not noted with other groups, either of iiegroea or 
of whites. The doubt concerning coaching, and the fnet that these 
testa and the norms for grading them were developed primarily 
for adults, would render the high school comparisons eomewhat 
inconclusive, and would emphasize, the results from the college 


groups. 

The second group of negro students was from Shaw University, 
in Raleigh, N, C, The men tested were selected by the President 
of that University. Shaw University is one of the best negro insti¬ 
tutions in the South in regard to college ranking. Eighteen men 
were tested there, during a period of three days. The writer does 
not believe that any of the men in this group were coached. 

The last group of negro students was from the Negro Agri¬ 
cultural and Technical School, at Greensboro, N. C. This is a 
state institution, but, owing to the fact that agricultural schools 
usually, have lower standards of admission than the Colleges of 
Liberal Arts in the various Universities, it is possible that a 
comparison of the men in this group with men from the Univer¬ 
sity would be unfair, Still, the three negro school.s visited are 
typical of the institutions of that race, and the men afford a 
better basis of comparison, being more widely distributed, than 
if all the subjects were taken from one institution. At the 
Agricultural and Technical School, eighteen men were tested dur¬ 
ing period of three days, sixteen of the men being of college 
grade, and two of high school grade. 

Although precautions were taken to standardize the subjects 
in regard to education, it must be admitted that the criticism of 
Arlitt^’ Regarding differences in social status holds good here. 
Derrick’® reports that ”White boys from average environment go 
to-college nearly twice aa frequently as negro boys from average 
negro environinent"* thus, the negro college students are more 
highly selected from their environment than the white students from 
theirs. The group of negro agricultural college students furnished 
a partial check on this condition, but for the best study in race 
comparison, it would be necessary to select a large number of in¬ 
dividuals from all environments. The present comparison can 
-claim to hold good only for college a.nd high school students of the 
' two races. 


“ A', On nie Need for Caution in NatahUfihtnff Jiacc Norms. 

Jourual of Appl ed Pgyclioiogy, Vol. fi. No. 1, March, 1921, 

^ ^ T "/ Intolligende of White and OoJored 

College Sirxderifs. Journal of AppUed Psychology, Vol, 4. pp. 910-329, Do- 
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To better inaure uniformity in veaiilt.Sp all of the tests here 
reported were ^iven by one of the writers and were ijrndcd by him, 
The grades were chcclced by the same writer and by a student 
trained in tlic method of 

Ib is not thought necessary to give an exhaustive description 
of the VViil-Teniperament Test, but definitioiia of the traits scored, 
and li statement of the value of the scores ijj each, are necessary 
^or a full understanding of the reBidls, In the order in which 
they are listed by Prof. Downeythey arc: 

Speed of Movement: Speed of movement of person relative to 
siz:c and age. A score of “10“ hero Indicntcs a very high speed, 
grading down to “1", which indicates very slow move men t. 

f’rGedo»7i fro7ii Loud or Inertia: Tendency to work at one’s 
highest speed without external pressure, little tendency to relax 
speed, quickness in warming up to a tn!?k, A score of “10“ indi¬ 
cates practically uniform speed, “1“ indicates groat Inci’cnse, which 
may moan that the subject usually works inorc slowly than he 
could—that ho has excessive “load” or weight of inertia. 

Flexibility: Ease and success in rendjiistmcnt; capacity to 
modify one's routine reactions. A score of “10“ here indicates 
highest success, “1,“ practically failure. 

Speed of Decision: Quickness in reaching a dccieion or con¬ 
clusion. A slow rcactioji hero may be duo to caution or con¬ 
servatism in weighing the elements involved in a situation, or be 
caused by one's being side-tracked by irrelevant matters or a 
rambling procedure. Here “10“ indicates a speedy decision, “1“, a 
very slow decision. 

Motor Impulsion: This trait refers both to impetuosity and 
energy of reaction. Consider tlie ease with vi/hicb tlie brakes or 
inhibitions can be removed, and also the tendency to explosive re- 
action when the brakes are actually olf. A “10“ here indicates 
explosive or expansive reaction under cliatraction, grading down 
to a "1,“ which indicates inhibition or withdrawal into one’s self, 
Eeaction to Contradiction: This refers to the degree of con¬ 
fidence with which one maintains his opinion against contradic¬ 
tion. A “9“ or "10“ reaction signifies an aggressive subject—the 
burden of proof is thrown on the person who does the contradict¬ 
ing; "7" and "8“ are confident reactions, but I’casons are cited for 
one’s confidence and the burden of proof is accepted; "5“ and "6“ 
are tactful reactions; below "5“ there is a grading down to com¬ 
plete failure to assert one’s own opinion, 

Resistance to Opposition: The vigor with which one reacts im¬ 
mediately to n blocking of one's purpose. It grade.s from “10“, a 

“ UowTii'y J. K. ,1/anifn/ of IJlrcotion,^ for Tcatinp. World Book Co., 
roiikors-oii-Ui>(l«oii, N. y., 
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strenuous reaction, to "I”, complete passivity in the face of 

opposition. j . . I,. 

Finality cf Judgment: Confidence in previoua decision, willing^ 
neas or unwillingness to reopen a question once closed. A 
indicates refusal to reconsider, or a very rapid reconsideratioti, a 
indicates extremely slow reconsideration. Sometimes the sub¬ 
ject spends as much time on review as he does on the original 
decision. The score in this trait should be interpreted while benr^ 
ing in mind the score or time spent on the original decision. 

Motor Inhibition: Capacity to keep in mind a set purpose and 
achieve it slowly. It involves power of motor control, imperturba¬ 
bility, and patience. A score “10*’ indicates highest success, a 
“1” indicates practically no inhibition. 

Interest in Detail: Attention to details. This trait is not equiv¬ 
alent to accuracy, but rather it indicates thoroughness, which may 
or may not be accompanied by analytical thought or’ insight, 
A "10'' indicates highest care for details, a "1" shows very 
little care, 

Co-ordination of Impulses: Capacity to execute a double task 
without preliminary trial, capacity to handle a complex situation 
successfully without forgetting either factor involved. This trait 
ia probably allied to keeping one's‘head in a confusing situation. 
A “10" here indicates greatest aucceas, a “1“ indicates practically 
failure. 

Volitioiiat Pcraeueratioii: Absorption m- a task; 'wilUngne 3 & 
to keep "plugging away" at it because the examinee sets up a 
goal for bimBslf, A “10" here is also the most desirable score, 
while a “1“ indicates little desire to take pains in porfectiiig n. 
piece of work that the, individual takes personal pride in. 

The scores in the Downey tests were obtained by taking the- 
records of a large number of individuals, for some given trnit,. 
and assigning score values in such a way that 10 per cent of 
the persons tested attained each score. Thus, in a given group, 
we could hardly expect to find normal distribution curves for the- 
various traits, but rather a tendency for an equal number to 
attain each score. Further, the total score made on the test is 
not as significant as the grouping of the scores in. the various, 
traits, although it has been considered that a high total score 
indicates a "strong" personality, and a low total score indicates 
a X weak" personality. Also,, the tests and grading norina were- 
devised for adults, and this should be taken into consider a tio a 
when these testa are given to younger subjects, 

G. M. Ruah^ gives a criticism of the Will-Tempernmcnt 


° and the Reaulta froiii'iho Downen 

JonmM of Apphed Psychology, Vol. 6, Wo. 2, June, 1021 
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Test, in rcg-nrd to corrclntion of the rcaulta and estimcilcis. He 
finds, for fifteen subjects, very little coirclation between the 
estimates of the traits and the acoren in thofic traits as tested 
by the WiH-Tcmpenimcnt Teat. Prof. Downey”; however, 
^slng' n slie'htly di/Terent mothofl of estimates, found su/Rcie^ifc 
correlation to justify the testa. 

RESULTS AND INTERPRETATIONS 
Table I contains the summary of means and znedians of the 
scores in the various trails for the two races, divided into caliche, 
hififh school, and combined groups, with the standard deviation 
from the monn in the varioiis traits for the two aollege groups. 

TABLE L 

College Students High School Combined 
WHITE HTUniONTH 


Trnlt 

Mcat\ 

[ s. r>. 

.Medlnri 

Menu 

Mrdlfjfi 

^ionn Mpfll/in 

Speed of Movement . 

..6.77 

2.631 

7 

4.13 

3 

5,46 

5 

Freedom from Load . 

.6.41 

2,627 

6 

6.71 

7.r> 

G.OG 

6 

Flexibility . 

.6.16 

1.740 

6 

4.13 

4 

4.G6 

6 

Speed of Decision . 

.4.10 

2.888 

4 

3.21 

3 

3,G6 

3 

Motor Impulaiozi . 

.4,61 

1.781 

6 

3,76 

4 

4,14 

4 

Reaction Lo Contradiction 

5,79 

2.451 

7 

6.60 

6 

6,G6 

G 

Resistance to Oppoaition 

6.77 

2.731 

7 

6.60 

7 

6.G3 

7 

Finality of Judgment. 

.4.92 

2.302 

6 

6.60 

6 

6.26 

5 

Motor Inhibition . 

.6.41 

3.409 

6 

4.G0 

6 

6.01 

6 

Interest in DeLnil .. 

,.7.33 

1,489 

7 

6.44 

6 

6.S9 

7 

Co-ordinntion of 








Impulses .. 

.6.02 

2,882 

7 

3.06 

2.5 

4.82 

4 

Volitional Perseveration. 

.6.04 

2.966 

8 

6,81 

6 

G.23 

7 

NEGIIO STUDENTS 





Trnlt 

Mour 

1 H. D. 

Median 

Mean 

Medtfin 

Mean Median 

Speed of Movement. 

.4.10 

3.070 

3 

3.08 

2 

3.60 

3 

Freedom from Load ....... 

,6.48 

2.716 

6 

6,87 

6 

6.67 

5 

Flexibility . 

.4.00 

2.000 

4 

4.23 

4 

4.11 

4 

Speed of Decision. 

,3.87 

3.048 

2 

4,71 

4 

4.28 

3 

Motor Impulsion . 

,.6.16 

1.956 

6 

6.47 

5 

6.31 

6 

Reaction to Contradiction 

6.10 

1.997 

7 

6.81 

7 

6.46 

7 

Resistance to Opposition. 

.6,33 

2.641 

6 

6.06 

6 

6.19 

5 

Finality of Judgment . 

.4.77 

2.301 

5 

6,29 

7 

5.62 

6 

Motor Inhibition . 

.3.84 

3.519 

3 

6.76 

8 

6.28 

6 

Interest in Detail . 

.0.82 

2.146 

7 

6.52 

7 

6.67 , 

7 

Co-ordination of 








Impulses . 

.3.87 

2MS 

3 

2.13 

1 

3-01 

2 

Volitional Perseveration. 

..6.69 

2-624 

G 

6.80 

7 

6.74 

7 


Doivoey, J. R J/’Af WiIf-J*yoflIc, A Tenttiihw Scale for Mensnronient 
of Iho yoMdonfll i^aHcra. Unlv. of Wyoming Bulletin. Vol. 115, No. OA, Feb- 
1910. 
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Attention must be called to the tact that a composite profile 
plotted from mean or median scores^ as given in Figure 1 and 


figure 1. 


Mean Scores. 
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Figui'e 2, must be read with caution, since there is so great pos¬ 
sibility of individual variability in the scores in each trait. Also, 
these profiles do not indicate, more than in a very general way, 
tendencies toward racial patterns- However, from Table I, and 
Figures 1 and 2, we may say in general that the ''average” 
white student has greater speed of movement, that he has slightly 
greater freedom from load—that is, he tends to work on the 
weighing of the evidence, or leas decisiveness; that he is slightly 
average more nearly at his greatest speed; that' he haa slightly 
greater flexibility and ability to ijieet new conditions in life; that he 
is slightly slower in making decisions—^which may mean a better 
less liable to become explosive under distraction from conflicting 
stimuli; that he is less forceful when contradicted, which may mean 
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II ;yreftter degree of Gocial adjustment (a score of "fi"' is the tact¬ 
ful response), or n greater degree of suggestibility; that he is 
firmer when confronted by obstacIcH or physical opposition; that 
he takes about the -same Lime, or slightly longer in reconsidering 

FIOURK 2. Median *Scoies, 
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his decisions, which may be due to greater care, or to greater 
indecision; that he has, as a college student, greater ability or 
desire to restrain his impulses, and, as n high school student, less 
ability or desire (but here must be remembered the criticism given 
above, that there was some evidence of coaching upon the results 
from negro high school students) ; that he has practically the same 
interest in detail; that ho has a markedly greater ability to cO' 
ordinate his impulses, or to meet confusing situation; that he 
has a slightly greater tendency to volitiunal perseveration. 

Figure 3 sihows the distribution of the individual scores in each 
trait, for the high school students, the college students, and the 
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combined eroiipg, of both races. Score values are indicated on 
the horizontal axis, .nirmber of individuals on the vertical. 

The median profile of the high school students (Figure 2b) 
shows emphasis on the traits which combine to suggest an aggres¬ 
sive personality, a result which was found by Dr. Downey” 
in testing high school freshmen. 

A point *niay here he brought out in relation to the negro's 
tendency to resist contradiction more strongly than the white. 
Dr, Bevia’^ tabulating the frequencies of various forms of 
psychoses among the Southern negroes, reports that dementia 
praecox stands at the head of the list of their psychoses, with the 
catatonic form occurring about twice as often as in the white. 
Since one of the characteristic symptoms of the catatonic form 
of dementia preacox is negativism, the result of this test checks 
fairly with Dr. Bevis' report Also, (and cf. No, 6 in ''Summary'") 
we might expect a greater degree of aggressiveness from the 
negro when he is allowed to reveal his inner self. As a race, 
they are generally oppressed or held down, a fact which might 
lead us to look for a reaction in the direction to greater aggres¬ 
siveness when unchecked, Observations of Northern negroes have 
been reported, where the negro, freed from race restraints, has 
swung to the other extreme and has been rather too aggressive; 
and the • tendency of the negro drivers to beat their mulea more 
mercilessly than do white drivers, is a matter of observation, 
This is apparently a case of "inferiority? complex" and "com¬ 
pensation". 

The lower score of the white students in motor impulsion might 
have been expected. Oduifi^ says, "The two general character¬ 
istics, then, the negro's emotional nature are the lack of restraint 
and the consequent extreme expression of the feelings."’ Theee 
would naturally be allied with greater motor impulsion, 

. Varioua investigators have made different reports regarding 
the variability of the negro as compared with the white. Fergu¬ 
son^ says that no certain conclusion as to racial variability can 
be reached, adding "It may finally be remarked with regal'd to 
the^ relative variability of whites and negroes, that it would not 
bo at all surprising if groups of so-called negroes were deftnitely 
shown to he more variable than comparable groups of whites. For 
■the groups that are generally called negroes are composed of in- 
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dividuals ranging from pilre negroes to persons almost white, 
nnd it would be reasonable to suppose thnt such groups would 
vftry more than would homogeneous white groups.” Mnyo" states 
that mental variability is less in negro high school students than 
in white high school students, the rntto Toeing M to ICO. Tierrich® 

TABLE 11. 


Comparison of the Standard Deviations of the Scores Made by the 
White and Negro College Students in the Various Traits 



White Negro White 

Per Negro 

Per 

Trait 

S. D. 

S. D. Excess Cent Excess Cent 

Speed of Movement .. 

.2,631 

3.070 

.539 

21.3 

Freedom from Load . 

.2.537 

2.71G 

.179 

7.0 

Flexibility ... 

.1.740 

2,000 

.260 

14.9 

Speed of Decision . 

.2,8B8 

3.046 

.167 

B.4 

Motor Impulsion. 

.1,781 

1.965 

,174 

9.7 

Keaction to Contradiction . 

.2.461 

1.997 .464 

22.2 


Tteaistance to Opposition 

.2.731 

2.641 .090 

3.4 


Finality of Judgment . 

.2.392 

2.301 .091 

3.8 


Motor Inhibition ... 

,,...*.3.409 

3.619 

.110 

3.2 

Interest in Detail .. 

.1.489 

2.146 

.067 

44.1 

Co-ordination of Impulses . 

.2.882 

2.836 .044 

1.5 


Volitional Perseveration 

.2.966 

2.624 .441 

18.2 


Average Per Gentage 
of Excess . 



9.8 

IB.l 


finds the opposite in regard to college students, when compared 
in respect to intelligence. lie says ''The white college student was 
about 77 per cent as variable as the negro.'^ Nor is anything 
definite concerning variability found in the results from the Will- 
Temperament Tests. Inspection of the distribution curves for 
the scores in the various testa (Figure 3) shows practically no 
preponderance of either race. Comparison of the standard devia¬ 
tions from the menn in the scores made by college students, 
Table II, shows that the negro deviations exceed those of the 
whites in seven of the traits, and that the amount of excess is 
relatively greater. There would, then, seem to be a alight but 
not striking tendency for the negro to be more variable. 

After the comparisons given above were made, the results were 
analyzed in terms of ages and academic grades. Except for the 
preponderance of freshmen In the white high school group, and 
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TABLE IIL 

Diatribution of subjects by ages and grades, 
WHITE HTIIDENTH 

High School College 


Age 

Fresh. 

Soph. 

Jun. 

Sen. 

Freah. 

Soph. 

Jun. 

Sen- 

10 

1 








11 









12 









13 

5 








14 

2 

1 

1 






15 

5 

1 

1 






16 

3 



1 





17 

1 

1 


2 

1 




18 

2 

1 

1 

1 

2 

5 



19 

1 




1 

6 

3 

L 

20 

1 

1 




B 

3 


21 


2 

1 



3 

4 


22 


1 




2 



23 

1 





1 



24 







1 


25 









26 






1 



Total 

22 

8 

4 

4 

4 

23 

11 

1 




NEGRO STUHRNTa 





High School 




College 


Age 

Fresh. 

Soph. 

Jun. 

Sen. 

Fresh. 

Soph. 

Jun. 

Sen- 

12 

1 








13 









14 

2 








15 


1 







16 

1 








17 

2 


* 


1 




18 

3 

5 

1 

1 

1 




19 

2 

2 

1 

1 

1 

2 



20 


1 

2 

1 

3 

2 



21' 



1 

1 

2 


2 

1 

22 






2 

1 

1 

23 

1 


1 

3 

1 

1 


2 

24 



2 


1 

1 

2 

2 

25 



1 



1 

1 


26 




1 



1 

2. 

27 





1 



3 

28 








1 

T^tal 

12 

i) 

9 

8 

11 

D 

7 

12. 
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Mean gcorea by Qgea of subjects, 
WHITE STEDEHTH 


Age 

SM 

EL 

P SD 

Imp. RC 

RO 

PJ 

Inh. 

ID 

cr 

VP 

104 G 

3.81 

6,38 

4.24 d.36 

3.90 6.81 

4.81 

5.66 

6.7G 

6.76 

4.38 

6.28 

1749 

G.C6 

6.07 

4.89 4.20 

4.79 6.00 

G-U 

6.38 

6.24 

7.14 

5.20 

6.07 

20-22 

643 

6.82 

4.78 3.48 

3.69 6.91 

5.69 

4.78 

4.17 

G.82 

4.6G 

6.62 

23-28 

6.7B 

5.76 

6.50 2.25 

3.26 7.60 

6.00 

B.OO 

3.76 

6,26 

B.76 

5.69 




NBGllO STUDENTS 






Age 

•SM 

PL 

F SD 

Imp. RC 

RO 

FJ 

Inh. 

ID 

Cl 

VP 

1043 

2.00 

340 

4.20 4.80 

B.40 6.00 

5.40 

'T.OO 

7.20 

6.80 

2.00 

0.00 

1749 

2.3B 

6.74 

3.87 4.66 

6.49 C.69 

5,17 

6.09 

6.26 

6.66 

2,69 

6.22 

20-22 

6.16 

6.30 

4.10 B.OO 

4.86 6.10 

6.00 

B.96 

4.B0 

6.95 

4.0D 

6.40 

23-28 

3.02 

6.68 

4.31 3.24 

B.B5 6.48 

B.31 

4.66 

6-62 

6.34 

2.76 

6.79 

For number 

of subjects in 

[ each group. 

and ] 

grades represented, 


see Table 3. 
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of sophomores in the white cotlej^e Kroiip, the distribution of atu- 
dei^ts is npproximutoly the Hume in both rncoH. Table IH hIiowh the 
distribution by apre and i>rudca, I'roni inspection of thin table, 
it is seen nt once that the ne/rro .stndenl is fioni two to three 
yeqrs older than the white student of the stimo ffiade. Tliis 
rctnrdation nuiy be caused Ijy adverse environnieiit or by inferior 
intelligence of the negro. Probably both factor h arc at work. To 
ciiminnte as much as possible tbo iunuence of ago on the scores 
made by the group.s, the subjects wx‘rc; divided into four Hretions, 
the first aoction containing those 1(1 years of age and younger, 
tho second section containing those from 17 through 19, the third 
those from 20 through 22, and the fourth those 23' and above. 
Table IV gives the mean scores made by cacli section in each 
Lrnit and Figure *l shows the profiles plotted from these data. It 
will be seen from inspection that, as the subjcctn grow older, there 
is a tendency for increased scores in speed of movement, flexi¬ 
bility, i-Gaction to conlrndiction, and co-ordination of impulses^ n 
tendency for decreased scores in speed of decision, finnlity of 
judgment, motor inhibition, and perhaps volitional persevera¬ 
tion i the scores for motor iiniHilsioii tend to remain about the 
.same; in freedom from loud, the white scores remain about the 
same, or decrease slightly, while the negro scores increase with 
in resistance lo oppositioji, the white scoi'cs jncrou.se, and the 
negro scores remniii about the same; in interest in detail, the 
ivliito gcores clGcrensc slightly, while the negro scores vary. The 
iiicrcasG in speed of movement may be due to inci'casod use of writ¬ 
ing, the neccaslty for rapid note-taking, or the influence of other 
situations in every-day school life that call for speed in writing. 
The increase in the throe other trails noted would probably be due 
to a deeper renlizqtion of problems as such, and the consequent 
tendency to eliininatG "snap judgments". The decrease in motor 
inhibition and volitional perseveration rnny be due to tho greater 
vnlue which the older person puts upon time, or, in the case of 
motor inhibition, the decrcn.'^c of content which the tost-phruse 
holds for him, ami the consequent increase in difflculty of the 
tost. A person^a rating in motor impulsion is probably a 
fundamental part of his make-up, anti would hardly be expected 
lo change in either direction- A true race dilTerencG may be 
indicated by the di/Ferenee in the change of scores foi* freedom 
from load, in which those for the whites remaiiiGd nearly constant, 
and those for the negroes' increased. The negro score in this 
trait never increnaed enough, however, to bring it up to the lowest 
score of the whites. In auch a trait as resistance to opposition, 
the increase in white scores, while the negro scores remain nearly 
constant, may indicate an earlier maturity on the part of the 
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negro. The decrease in fecorea for the white students in interest 
in detail may indicate, ns noted above, an increased valuation of 
time. 

In order to check the above claasification of the groups into 
age-sectiona, another classification was made, this time into gvade^ 
aectioTis. Here it is evident, the factors of intelligence and greater 
capability come into play, and we may be fairly sure that the 
higher the grade, the higher the intelligence level,, since there 
is a selective factor at work to eliminate those of less native 
capacity. Table V gives the mean scores attained by the various. 

TABLE V. 

Mean scores by school grades of subjects. 

WHITE STUDENTS 

Grade SM PL P SD Imp. EC RO FJ Inh. ID Cl VP* 

HS 1-2 3.56 6.46 3.93 2.76 3.70 B.GO B.50.6.36 ’4.3C 6,16 3.90 5.66. 
HS 3-4 G.26 7.62 4.B7 4.87 4,00 6.12 6.60 0.60 5.50 7,60 3.62 6.86 

C 1-2 7.04 5,74 6.04 4.00 4.33 6.89 B.74 4.88 6.96 7.22 6.44 6,68 

C 3-4 6.08 7.66 5.41 4.33 4.91 4.83 5,83 5.00 4,17 7.B8 6.08 6.75 

NEGRO STUDENTS 

Grade SM PL P SD Imp. EC EO PJ Inh. ID Cl VP' 

HS 1-2 2.09 5.09 3.38 4.33 6.57 5.47 5.00 6,81 6.30 4.91 2.33 5.71 

HS 3-4 4.06 6.82 4.23 5.18 6.36 7.23 5.12 6,66 7.23 7.20 1.88 5.88> 

C 1-2 4.40 6.26 4,06 4.76 4.95 5.86 5.66 6.20 6.45 6,15 3.86 6.30 

C 3-4 3.86 5.79 3.96 2.96 4.84 6.37 6.42 4.21 3,79 7,58 3.89 6.10 

Average ages of above groups; 

HS 1-2 HS 3-4 C 1-2 C 3-4 


Whites ..16,8 17.0 19.74 20.33 

Negroes .17.66 21.59 21,2 26.68 


For distribution of ages, and numbers in each group, see Table 3. 

sections, and Figure 6 shows the profiles plotted from the data. 
In this case, with increase in grade, there is nn increase in the 
scores of more traits than when the student’s increase is in age. 
Inspection shows that there are increases in the scores for speed 
of movement, flexibility, resistance to opposition, interest in detail, 
co-ordination of impulses and volitional perseveration. Finality 
of judgment is the only trait in which, there is a deereage. Th&' 
scores for freedom from load, reaction to contradiction, and motor 
inhibition remain about the same, or vary irregularly. There is 
a slight increase in the scores for speed of decision and motor 
impulsion for the Avhites, With a decrease in these traits for the 
negroes. With increased intelligence and stronger personality, one 
would naturally expect higher scores. For finality of judgment,. 
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the decronsD ia from above "5" lo about "J>*' which is t)»e normal 
score. The advanced Btudciila Heem to be leas addicted to hn,sty 
reviaion. The constancy of Llic traits freedom from load, reaction 
to contradiction, mid motor inhibition, mny indicuto timt normal 
scores in these trails are Hiifllcicnt fur proliciency in school work, 


Figure V 
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although it would Seem that the advanced student would gain in 
resistance to contradiction. The opposite direction in which the 
scores tend, for the two races, in speed of decision and motor 
impulsion is probably indicative of racial characteristics, and may 
otFer good returns for further investigation. 

Since, na stated in the first part of this section, a study of mean 
or median scores offers little that is definite in the way of racial 
temperamenl patterns, the scores for the college students were 
gone over in an attempt to list any tendency toward groupings of 
the high scores found there. Following Professor Downey in the 
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main, \v<i may suggest that there are three types of such group- 
ings—those in the traits listed as the first four chaructevizing one 
as mobile or rapid-fire in organization, aa the second fo\ir charac¬ 
terizing him as aggressive or forceful, and as the tliird four the 
controUed, deliberate, careful type. Also, there may be combinn- 
tiona of any tw groupings, or of none nt all—the profile may 
be balanced or else very irregular. The method foilo^vcd here 
in listing tendencies was ns follows: The Hrst four scores in 
each individual's case were added together, us were the second 
and third seta of fours. These sums wci'O coiupared, and when 
the sum of one group exceeded the sum of cither oi the other 
groups, the individual was listed as being characterized by the 
tendency correlated with that group. Whero no one group ex¬ 
ceeded either of the others by three or more poiuta, there were 
two possibilities—either that the individual hud u well balanced 
profile, or else there was a combination of tAvo high groups ond 
oiie low one. If the first was the case, he was listed ns "Balanced"; 
if the second was the case> he was listed under the combinaliou 

TABLE VI 

Showing distribution of college students according to the group of 
traits in which each received his highest scores. 

1st 2nd 3rd lstaiid2ud 2nd and 3rd 1st nnd 3rd Balanced 

Whites ...4 6 14 1 G 5 3 

Negroes 2 9 8 4 8 3 5 

of his two high groups. Table VI gives the results of this attempt 
to classify the patterns, From this table wc may sec that the 
whites slightly surpass the negroes in the numbor of mobile, rapid- 
fire individuals; they have a clear suiieviovity in the number of 
controlled, deliberate, carefnl persons; nnd they slightly aui'pnss 
the negroes in tHe number of individuals showing a combination 
of these two characteristics. The negroes slightly surpsusa the 
whites in the number of aggresaive persons a^d in the number 
of persons combining ciuicknesa and mobility with aggressiveness, 
nnd also in the number of individuals combining aggressiveness 
and deliberation. 

As a last point, Professor Downey suggests that, while there is 
not as much significance attached to the total score of each individual 
as to his scores on various traits, still, a high total score is, in 
general, indicative of a ^'stronger personality," and a low total 
score is indicative of a weaker personality. On this assumption, a 
tabulation of total scores of the college group way made, and a 
dislTibntioTi curve was drawn from the rcaulta. See Figure G. 
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FIGURE 6* 

Distribution of total scores of CollGge students. 
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Six negroes (16.4%) passed the white median. 


It WHS found that the white college aUidenls surpassed the hegro 
college students in their totals, which, therefore, would indicate, 
that, in general, the whites have "greater force of personality.*^ 
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SUMMARY 

1. In general, the negro is slower in movement than the white,, 
has*about the some or slightly greater load or inertia; has alightljr 
less flexibility; is slightly quicker in making his decisions; his 
motor impulsion is slightly greater; reacts more firmly against, 
contradiction; but offers less resistance to physical opposition; 
takes about the same or slightly less time in reconsidering his: 
decisions; the negro college student has leas motor inhibition, the 
negro high school student has greater, compared with white stu¬ 
dents; the negro has practically the same interest in detail as the 
white, has markedly less ability in co-ordinating his impulses; and 
has a slightly less tendency to volitional perseveration. 

2. There is little difference in variability, but the negro college- 
student has greater variability on seven of the traits, as opposed 
to the greater variability of the whites in five, and the amoifnt of 
the negroes' variability is slightly greater. 

3. In general, the negro college and high school student ia 
from two to three years older than the white student of the same, 
academic grade. 

4. As to the influence of age (from early adolescence to the 
middle twenties, as the subject approaches maturity, there is a 
tendency for increased scores in speed of movement, flexibility, 
reaction to contradiction, and co-ordination of impulses; a tendency 
for decreased scores in speed of decision, finality of judgment 
motor inhibition, and volitional perseveration, the scores for motor 
impulsion tend to remain about the same; in freedom from load, 
the white scores remain about the same, or decrease slightly, and 
the negro scores increase with age; in resistance to opposition, the 
white scores increase and the negro scores remain about the same; 
in interest in detail, the white scores decrease, while the negro- 
scores vary, 

6. As to the analysis of mean scores by grades (probably in¬ 
fluenced by the factor of increasing intelligence in direct ratio to 
the higher grades): the scores for speed of movement, flexibility,, 
resistance to opposition, interest in detail, co-ordination of im¬ 
pulses, and volitional perseveration increase in the higher grades' 
the scores for freedom from load, reaction to contradiction, and 
motor inhibition vary; there is a slight increase in the scores for 
speed of decision and motor impulsion for the whites, with a de¬ 
crease in these traits for the negroes, from the lower,to the higher 
grades. 

6. In predominance of temperamental patterns, the whites, 
slightly surpass the negroes in the number of mobile, rapid-fire 
individuals; they have a clear superiority in the number of con^ 
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trolled, deliberate, careful persons; and they slightly surpass the 
negroes in the number of individuals showing a combination of 
these two characteristics, The negroes slightly surpass the whites 
in the number of aggressive persona and in the number of indi¬ 
viduals combining quickness and mobility with aggressiveiiessi and 
also in the number of individuals combining aggressiveness and 
deliberation. 

7. In ^'strength of personality," ns indicated by the total score 
of each individual, the whites surpass the negroes, only 15.4 per 
cent of the negroes exceeding tile median of the whites. 



A STUDY OP THE DATA ON THE RESULTS GATH¬ 
ERED FROM repeated MENTAL EXAMINA¬ 
TIONS OF 200 DEFECTIVE CHILDREN 

attending special schools 

OVER A PERIOD OF EIGHT 
YEARS 

By Meta Andersom 
Director Binet Classes, Newark, N. J. 

Altlioug’h the worh ior detectives wns beern'i iti iti Sep¬ 

tember, 1910, it was not tmtil 1913 that the organization of the 
work permitted anything lihe systematic re-examinntion of the 
ciiildren admitted to the special schools and even then compleW 
yearly re-examination of the whole special school population was 
not accomplished. However, since 191G it h.Ts been possible to 
re-exnniine each child in the special schools yearly excepting a 
■few cases which will be noted later. The object of the work was 
to get information in regard to the growth of intelligence of 
the children in the special classes (now called Binet Classes) in 
order, if possible, to know better how to train them and to 
eliminatG errors in their training and education. The object of 
this study was bo organize, classify and analyze these data in 
order to get further mformatiou in regard to types of uTCntal 
growth curves and in order to get further information in regard 
to the value of the intelligence quotient, 

While the population of the Binet Schools is upward of five 
hundred pupils only two hundred were studied here. These two 
hundred cases vary from the grade of low grade imbecile to 
that of high grade moron. Before Jamiary, 1918, the cases were 
, selected for the Binet schools because they were failures in the 
regular grades and at the same time fell more than three years 
below normal according to an intelligence test (this standard 
being set by the New Jersey law). Since January, 1918, the 
cases have be eh selected by the Psycho-Educational Clinic of the 
city. Each case is certified as being definitely feeble-minded 
before being sent to a Binet School, 

Each case was examined from three to eight times at not less 
than a year's interval. The majority of the cases were ve- 
examined by the writer. The others were examined by two head 
assistants in the department both of whom were unusually well 
trained to do the work. 

In a department always having a population of 600 defective 
children it would seem possible to have numbers of retests on 
at least that many children. This investigation has shown that 
the turnover in the population of the Binet Schools is very great. 
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Mniiy of the children except the lowest j^rade nvc naaigned to 
special work late in their school career. These children are not 
presentod for psychological examination unLil the regular schools 
have done all in their power to help them succeed in their work. 
Hence* it is only after their inability to learn has become most 
marked or their behavior disorders have become unbearable that 
these clnhlren fire assigned to Lbe JlineL SchooLs. By that time 
the children are anywhere from ten Lo fourteen years of age. 
Since they leave school at sixteen and some times earlier as 
diU'ing the war when the pre.ssure for workers was very grent 
these eiiikhcn have short oppoitiniity for training, TIiLs also 
renders it imjKissible to liave ii great niimher of retests on the 
same individual. 

A certa'n percent age of this group also leave school to go to 
hou:cs of correction, to institutions, move from the city or are 
lost trad: cf. Therefore the number rcinaining in the Binet 
School.^ for move than four years is comparatively few, 

V/ith the present wider use of group lestJ defective cluldren 
a :'2 1 ) 2 :dis^nVLM'cd t^aidier in Uieir school career hut it will be 
necessarily n niiniher of years before sufficient (lain are gnthored 
on this new group for a worthwhile study. 

Before 1018 the Goddard revi.sion of the Binct tests wore used, 
since 1018 the Stanford revision of the Binct tests luive been 
used. 

The study falls into two parts. The first part has to do with 
the frequency of types of mental growth curves and the second 
part has to do with a study in values of the IQ. 

PART 1. FREQUENCY OP TYPES OP 1VIJ5NTAL GROWTH 

CURVES 

Other iNvr.sTioATioNs. 

Kuhlman has made growth curves on data gathered from re¬ 
peated retesta on inmates of the Minnesota institution and, he 
says: 'The main features of these growth curves present but 
little that is iiot now pretty well kno\vn, They show that the 
feeble-minded do develop mentally, and nt a rate in proportion 
to - the grade of intelligence. This was still a disputed point at 
the time this study was begun. This rate of development de¬ 
creases with age for all grades. The rate of this deci'case 
cannot, of course, be shown with this data, as we do not know 
how much mental growth in terms of absolute units the mental 
year represents at different age levels.'^ 

Kuhlmnn summarizes his results on mental age growth as 
follows; 
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The mental a&es of the feebie-Tninded mreasc with nge 
at a rate proportionate to the degree oi hacTital deftciancy. 

'*2, On the whole the mentnl age ceases to increase between 
the ages of fifteen to eighteen, the idiot grade ceasing develop, 
ment about three years earlier than the brordcrline grade. 

"3, For the cases dguving in the present study and for the 
liyne period they were under observation, 4.8 per cent of the 
cases gained twelve months or more in naental age in a year, 68 
per cent gain from' one to eleven months a year, 11 per cent 
gain or lose less than one month a year, and IG pet cent los^ 
from one to seven months a year in mental age, 

The lower grades lose more frequently in mental age than 
the higher grades. 

The frequency in loss in mental age increases with age, 
independently of grade. 

Doll says on the rate of growth for subnormals: ^‘Not much 
mole is known about the rate of mental growth among extreme 
subnormals, like the feeble-minded, than about the age of nh^eat, 
In this regard we are even at a loss for adequate observational 
data. Experience with institutional feeble-minded, however, sug¬ 
gests a great variety of possible forms of retardation curves. 
Such experience points to a amall but gignidcant group of feeble- 
minded who grade ‘at age^ by the Binet stale when first ex¬ 
amined but who make no material progvesa in later examinations 
over n period of years (Type A.) There are others (Type B) who 
fit the tirrie of first examination test at ago, then continue to 
develop at a retarded rata for a time and then reach a point of 
arrest, There is a third group (Type C) already retarded when 
first observed, who from the first examination to tlm age of final 
arrest develop at an annual rate of growth which is a con¬ 
stantly decreasing variable. There is also a fourth group (Type 
,D) who from the time of first examination to the age of final 
arrest. There are many variants and combinationa ,bf these 
basic types for individual subjects. We believe, however, that 
these four types comprise the majority of the feeble-minded. It 
is conceivable, though not probable, thut some individuals might 
have a higher than, average rate before retarding, tt is also can- 
celvable, though not likely, that the arrest might be relatively 
greater in the early ages with a curve of growth which would be 
accelerating at some intervals. It T&mains for experimental in- 
veatigatiem to show the relative frequencies of these different 
types of growth curves,^'^ 


^Kuhln^nn, n<iaulU ot H.ep(?aLqd nc-cxomtuDtlons of PeeWo-mlnded (099) 
15 og Ten Yenrs. Journal of Aptilled Pey, Sept,. 1021, 

Grow til oC lutelUeencc. Pay. Moungriipli, pp. 15 - 11 ) 
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With the vie'w -of deteTininiTiE' what light, if any, the limited 
data on hand could throw on the Bubjett of the growth of intelli¬ 
gence of feeble-minded Bubjecbs 100 mental age growth curves 
of pupils attending the BLtiet Schools from three to eight years 
were plotted. These curves were then classified according to 
Doll's theoretical intelligence growth curves as follows: 

T'ii'pe Ak (Doll) Those who teat ''at age'* by the Bluet acaU 
when first exaniine(J but make no material progress in later ex¬ 
aminations. 

* Type B. (Doll) Those who at the time of first examination test 
“at age,” then continue to develop at a retarded rate for a time 
and then reach a point of arrest. 

Type (Doll) Those who are already retarded at time of 
first examination but who continue to develop from the time of 
first examination until time '^f final arrest at an annual r;;te of 
growth which ia i constant ’7 decreasing variable, 

Type D, (Doll) Those who from the time of first examination 
to the age of final arrest develop at a constant rate up to time 
of final arrest. 

For convenience two new types were added although it is quite 
likely they could be easily included in one of the above groups. 
They are ns follows: 

Type E, (New) Those who are retarded at the time of first 
examinaticn, and who also have apparently reached tho time of 
final arrest. 

Type F, (New) Those who have developed at a constant or 
variable rate up to the time of apparent arrest, but who after 
two to four years of apparent arrest, have begun to develop 
again. 


NUMBER OF CASES TYPE 

I ... 4 to 6 

1 . A 

0 . B 

47 . G 

22 . D 

19 . 1 . E 

II . F 


100 

Of the 11 cases listed as type / there were 

4 who remained at aa apparent arrest for 2 years. 

who remained at an aUDarent arrest for 3 years. 

2 who remained at an apparent arrest for 4 years. 
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Of these 11 eases listed as type f there were 
2 cases who contirmed de'velopmaent for 1 year after arrest. 

6 caags who continued development for 2 years nfter arrest. 

2 cases who continued development for 3 years after arrest. 

1 case who continued development for 4 years after ai'reat. 

at which time there waa anothet apparent arrest or the children 
left school, 

Type f cases classified according to life age 
Number of Cases 

1 .. 

1 . 

6 .;. 

1 . 

2 . 

1 . 


Life Age 

6 to 7 

7 to 8 
9 to 10. 

10 to 11 

11 to 12 

12 to IS 


11 


Type / cases classified according to mental age 
Number of Gases 

2 . 

6 . 

1 .. 

1 .. 


Mental Age 
... 3 to 4' 

... G to 7 
... 7 to 8 
.... 8 to 9 


11 


SUMMARY. 

1 , Ifc is evident that a greater number ( 47 ) of the eases studied 
in this group have developed mentally according to Doirs theo- 
retical curve described as Type C, 

2, The next larger group ( 22 ) of cases studied have developed 
mentally according to Do)Vs theoretical curve described as Type D. 

3, There were 67 cases out of the 100 studied who were re¬ 
tarded when first examined and who then retarded either at a 
constant rate or at a steadily decreasing rate up to age of final 
arrest. 

4, Only one ( 1 ) case could be obviously classified under 
Type A. 

5, The 19 cases which were retarded when first examined and 
which developed no further at later examinations may or may 
not belong to Type A.That is^ it is possible that if they had been 
examined at earlier periods they would have tested ‘‘at age,” 
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The 11 CO sea under Type P could be claaaiflocl under Type? 
C in a brond claasification. They differ from'that type merely 
in the fact of having long periods of arrost but in the long run 
they develop at a dccrenaing rate up to the UniG of final arrest. 

7. It would appear from the study of these 100 cases that 
the majority 80 in this study of feeble-minded caaefl slow up 
^rndually in mentality up to time of final arrest and that com¬ 
paratively few develop normally for a time and then stop sud¬ 
denly. In this study not more than 20 of the caaes could have 
been said to have come to sudden tirroat and 19 out of the 20 
eases are doubtful. 

8. The 100 cases studied were all qlassifiod as feeble-minded 
and were attending Binet Schools. It is po-saible that feeble¬ 
minded cases which develop normally and then retard suddenly 
qre not discovereel early enough in their school careera to be 
selected for Binot Schools. 

P>\jiT II. Study jn Some Values of tjie I. Q. 

Prom three to seven testa were made on 200 children attending 
the Dinet Schools at intervals of a year in most cases. There 
are cases which are noted in which the rcteata were* made at 
greater intervals because the children were no^ available for 
examination either because they hud moved from, the city or 
attended anothei* school and then rc-ontored the Binet School 
when they were re-oxnminod. At the time of this study there 
were only two hundred cases who had been rc-examrned c suffi¬ 
cient number of times to make the study of their cases worth 
while, These cases then were nil selectod because they wore 
attending the Binet Schools and beenufle they had attended long 
enough to have from two to six retests made nt intervals of a 
year. 

The cases were classified and grouped. 

(a) According to life age at initial test and I. Q. in groups 
of tens. 

(b) . According .to I. Q. in groups of tens. 

(c) According to I, Q. and intervals of retests regardless of 
life -age. 

These groupings were made in order to study the I. Q* in its 
various aspects, 
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A, CASES classified ACC0IID12^(J TO LIFE AOK AT INITIAL TEST 
AND I Q-IN aitOUDS OF TKNS> 


No. of Cases. 

Life Age. 

Median I, Q, 

Number 

Median I. Q. 


nt 

of 

at 


First Test. 

Retests. 

Lnsb Test. 

0 

6 




2 

7 

38 

7 

44 Va 

1 

8 

39 

G 

41 

1 

9 

33 

4 

44 

2 

10 

31 

4 

26 

0 

11 




0 

12 




1 

13 

3G 

4 

29 


7 


1 

G 

44 

6 

42 

0 

7 




3 

S 

42 

6 

44 

3 

9 

47 

4 

47 

0 

10 




2 

11 

44 

3 

48 

1 

12 

49 

6 

40 

0 

13 





10 


3 

G 

66 

4 

44 

1 

7 

68 

6 

58 

3 

B 

69 

5 

66 

7 

9 

54 

3 

49 Va 

4 

10 

63 

3 

5VA 

6 

11 

54«5 

4 

51 

2 

12 

67 

3 

48 


26 


0 

6 




1 

7 

69 

3 

67 

3 

8 

61 

4 

63 

16 

9 

67 

6 

67 

6 

10 

67 

4 

68 

8 

11 

64l^ 

3 

67 

6 

12 

64 

3 

67 

2 

13 

64 

3 

66 


4() 
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A. CASES CLASSIFIED ACCORDING TO LIFE AGE AT INITIAL TEST 
AND 1 Q^IN GROUPS OF TENS. <CONTINUED ) 


No. of Cases, 

Life Age, 

Median I. 

Q. Number Median I. Q. 



at 

of 

at 


First Test. 

Retc.5ts. 

Last Test. 

2’ 

6 

74 

4 

60 

1 

7 

70 

7 

GO 

2 

8 

76 

4 

65 

0 

9 

74 

G 

48 

6 

10 

73 V2 

B 

56 

8 

11 

73 Vj 

3 

GO 

5 

12 

72 

3 

GO 


29 


SUMMARY OF RESULTS. 

1. The cQscs with I. Q/s from 30 to 30, incJusive, and with life 
ages from aix to nino years, inclusive, showed a gain in median 
L Q. of 2 to 11 points, 

2, The cases with I. Q.'s from 30 to 30, inclusive, and with life 
ages from 10 to 13, inclusive, showed a loss of 6 to 7 points in 
median I. Q. 

3- The cases ivith I. Q.'s from 40 to 49, inclusive, and with life 
ages of G years showed a loss of 2 points in median I. Q. 

4, The cases with I, Q.'a from 40 to 49, inclusive, and with 
life ages from 8 to 11, inclusive, showed n gain in median I, Q. 
of 2 to 4 points, 

6. The cases with I. Q.'s from 40 to 40, inclusive, and with the 
life ages of 12 showed a loss in median I. Q. of 6 points. 

G. The cases with I, Q.'a from 50 to 69, inclusive, and with life 
ages from 6 to 12, inclusive, showed a loss in median I. Q, of 
nothing to 9 points. 

7. The cases with I. Q.'s from 60 to 09, inclusive, and with life 
ages from 6 to 13, inclusive, showed a loss in median I. Q. of 7 to 

2, The cases with I. Q/s between 40 and 49 showed a loss of 1 
12 points. 

8. The cases with I. Q-'s from 70 to 79, inclusive, and with life 
ages from 6 to 12, inclusive, showed a loss in median I. Q. of 10- 
to 26 points. 

9. In other words, the younger cases with I. Q.'a from 30 to 39- 
inclusive, gained in median I. Q.; the older cases with I. Q.'s from 
30 to 39, inclusive, lost in median I. Q. 

10. With the exception of the 0-year-olda who lost 2 points in 
median I. Q. the younger cases with I. Q.'s from 40 to 49, inclusive,. 
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gained in median L Q.; the older cases with I. Q/a from 40 to 49, 
inclusive lost in median L Qi’a. 

11. All cases of any ago with I. Q.'s from 60 to 80, inclusive 
showed fl loss in median !• Q- 

I). CASES classified accohding to uj 
No. of I. Q. Range Median I.Q.'a at Successive Examinations. 


Cases 


1 

2 

S 

4 

B 

6 

14 

30-39 

36 

33 

31 

30 

37 


29 

40-49 

47 

49 

46’ 

48 

46 


63 

60-69 

66 

66 

64 

61’ 

60 

48 

69 

60-69 

G6 

60 

60 

68 

60 

67 

33 

70-79 

73 

67 

62 

60 

66 

66 


SUMMARY. 

1. The coses with I. Q.'s between 30 and 39 showed a gain of 2 
points in median I. Q. at the 5th re-examination, 
point in median I. Q. at the 6th re-examination. 

3, The cases with I. Q.’s between BO and 69 showed a logs in 

median I, Q, of 8 points at the 6th re-examination. 

4, The coaea with I. Q-’s between 60 and 69 showed a loss in 
■median I. Q. of 8 points at the 6th re-examination. 

6. The cases with I. Q.’s between 70 and 79 showed a loss in 
median L Q, of 17 points at the 0th re-exarainatibn. 

6. All cases with I. Q.'s below 60 remained practically sta¬ 
tionary with a gain or loss of but 1 or 2 points in median I, Q. 

7. The cases with I. Q.'s beWeen 70 and 80 showed loss. The 

highest initiai 1. Q. showed the greatest loss in median I. Q. at 
the final re-examinalion. 
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c. CARES CLASSIFIKH ArCOnniNG 
TO INTEllVALM OF RETICHTH. - 


TO fQ AND ALSO ACCORDING 


No. 

of IQ Median IQ^a at initial teat ami at intervals of retestg 
cases vaiigG Compared. 


12 30-39 34 - 32 ^ 
10 30-39 

12 30-39 
9 30-39 

6 30-39 

33 40-49 40-48 
24 40-49 

20 40-^19 

13 40-49 

7 

67 60-59 50-50 

64 60-69 
40 60-59 
19 50-59 
12 60-69 
7 60-69 
74 G0-G9 66-01 
64 00-69 
43 60-69 

21 00-69 

9 60-69 

33 70-79 73-07 
31 70-79 
26 70-79 

10 70-79 

11 70-79 


2 3 4 5 


3B“-28" 


34-33 

34-37 

39-42 


46-46^ 


.44-48 

44-42 

44-43 


65-53 


B5--56^ 

55-BO 

53M8 


65-GO 


65-58 

G7-G0 

66-56 


73-02 


73-01 

72-68 

72-56 


G 


50-49 


SUMMARY. 


All muillnii IQ'u 

In all rniiceH 

Hhowed 

n losH 

ntJ follows: 

Range of IQ* 

Points lost at 

successive examinations. 


1 

2 

3 

4 

6 6 

30-39 

1 

2 

3 

3 

5 

40-49 

Va 

: 

2 

2 

4 

50-59 

0 

1 

3 


6 

00-09 

4 

6 

7 

7 

9 

70-79 

6 

8 

11 

14 

IG 
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In qach group of cases the greater loss in median IQ occurred 
at the end of the fifth examinatibn. 

In each group of cases the gi-eatest loss in median IQ occurred, 
in the groups of the higher initial IQ's. 

CONCLUSIONS. 

1. A great majority of the cages who nve examined ns candi¬ 
dates for the Binck Schools are retarded at the time of first ex¬ 
amination and then retard cither constantly or at a decreasing 
ratio vip to time of final ancat, 

2. Compavatlvely few of the cases examined as candidates for 
the Binet Schools develop normally up to a certain age of arrest 
and then reaidin at arrest. 

d. In cases whose Intelligence Quotient is below 50 there is a 
tendency for the median IQ to remain constant or to gain or lose 
slightly. The median IQ shows a gain among tlie younger cases. 

4. All eases wth IQ's between 50 and BO show n decrease irv 
median IQ at any age. The highest initial IQ’s show the greatest 
loss in median IQ after repeated examinations. 

6. In the case of examinations at varying intervals the greatest 
loss in median IQ was at the interval of five years which was the 
last examination for all grades of cases. The grentest loss in 
median IQ was shown by the highest grade of cases. 

6. The IQ is variable in individual cases, 

7. No group of cases showed a marked increase in median IQ. 

8. These conclusions are merely for cases examined as- can¬ 
didates for Binet Classes. It is possible that repeated examinations 
on all retarded cases in a school system might give different re¬ 
sults. 



THE DOWNEY WILL-TEMPERAMENT GROUP TEST; 
A FURTHER ANALYSIS OP ITS RELIABILITY 
AND VALIDITY 


By G. M, Hugh and M. C. Del Manzo, 
University of Iowa. 


This paper presents the results of a statistical analysis of the 
scores of one hundred and forty-aix high school students tested 
with tlie Downey Group Will-Tomperament Test. The discussion 
of those results will be divided into four sections in accordance 
with the specific objectives of the investigation. 

I The Reliaiulity of the Test as a Whole 

Since the Downey tests are published in only a single form the 
usual method of obtaining reliability cocflicicnts by correlating 
equivalent forms is not applicable hero. Moreover, the common 
practice of breaking tests into chance halves for purposes of ob^ 
taining the self-correlation can only be carried out with certain 
qualifications as to the justice of this method, * In an earlier pa¬ 
per', one of the authors has argued that the correlation of the 
sums of the odd-numbered tests tngninst the sums of the even- 
numbered tests might fairly provide an approximation to a valid 
coclficient of reliability. A few words in explanation of the nature 
of the Downey Will-Temferamcnt Teats will help to make clear 
the limitations of the method of correlating chance halves. 

The scale is composed of twelve separate tests each designed to 
measure one aspect of the total volitional pattern. These are: 

A Speed of Movement (VI-1) 

B Freedom from Load (VI-1^ Z) 

C Flexibility (VIII) 

D Spqed of Decision (I) 

E Motor Impulsion (X) 

P » Self-Confidence (XI) . 

G Non-compliance (XII) 

H Finality of Judgment (XIII) 

I Motor Inhibition (VII) 

J Interest in Detail (IX) 

IC Co-ordination of Impulses (V) 

L Volitional Perseveration (VIII-2) 

Uliich, G, M.: "A Preliminary .SLiitly of Hie CorrelutloiiH Dctwceii Hull- 
miitoH or Volition 111 Tra'ltH ami llu* Ui-*HiiltH from I lie Downey ’Wlll-ProflJci«’,’' 
ot Psy ciioloKy, 
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This arraTigcniGiit of the twelve traits into three groups as here 
indicated follows the purpose of the author of the test in that 
traits A to D belong to a common ''pattern”; traits E to H belong 
to a second '‘pattern"; and traits I to L belong to ft third "pat¬ 
tern/* The groupings are intended to throw together the testa 
that are intended to reveal, respectively, three main types of voIL 
tional temperaments known, in order, as; 

I "Hair-trigger” organization, or the explosive type of Avill de¬ 
scribed by Janies (Testa A, B, C, and D). 

II "Willful, aggressive pattern” (Tests E, P, G, and H>, 
in "Slow, accurate, tenacious type” (Testa I, J, K, and L), 

The grouping and charaeterizations of the author of the teats 
16 adhered to here strictly. 

Since the scale is of the nature of a diagnostic picture m which 
certain groups (the three patterns) of tests can logically yield 
uniformly higli scores, while other portions can as logically yield 
Very low scores (or at least much lower scores), it follows that the 
total score on the whole scale will have very little meaning, It 
also follows that any attempt to split the total scale into chance 
halves must take care that equal numbers of tests be taken from 
each of the three .diagnostic patterns in forming such chance 
halves. If this is done properly we would then have two half- 
scales; each half-scale being composed of two tests from each of 
tliG three patterns or a total of six tests in each half scale. Such 
chance halves could be made up in this particular case in several 
way, viz., (1) the grouping of all of the odd-numbered tests in 
one half-scale and all, of the even-numbered tests in the other 
half-scale, (2) the grouping of the hrst two tests of every pat¬ 
tern into one of the half-scales and the last two teats of each 
pattern into the other half-scale, or, (3) the grouping of the first 
and last tests of each pattern into one half-scale and the second 
and third tests of each pattern into the second half-scale. 

In the paper mentioned above, the reliability of the Downey 
tests (individual form) was studied only by the first of these three 
methods. In the present report, the reliability coefficients have 
been determined by all of the three possible ways and the results 
averaged. Table 1 shows these results, The notations as "Method 
1/’ "Method 2,” and “Method 3” refer to the above-mentioned 
ways of obtaining chance halves. The notation "r -J-J” means 
that the coefficient of correlation stated was obtained by correlat¬ 
ing half (six tests) of the scale with the remaining half (six 
tests) of the scale. The notation "ru” is the porphecied correla¬ 
tion which would be obtained if two gimilar whole forma were cor¬ 
related. The values of the "r*i” column were calculated by the 
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use of B^o^Vll*a lormuln, n r 

r=- The ngea of the 

l-l-(n-l) r 

subjects cover a range of from ten to twenty-nine years. Grades 
seven to twelve are involved. 

TABLE 1 


R KLlAII r LI TY COlUrFICIK NTS 


Method 

r ll 

Til 

(Brown's formula) 

N 

I 

0.17 

0.29 

14G 

II 

0,31 

0.47 

146 

III 

0.24 

0.38 

146 

Average 

0.24 

0.38 

146 


The probable errors of these coefficients (Pearson product-mo¬ 
ment formula) range between O.OB and 0.06. Table 7 shows the 
probable errors of coefficients of correlation for the various values 
of r reported in this study. 

In view of tlie wide range of talent represented in the group 
tested, these reliability coefficients cannot be considered to be very 
satisfactory. They are, however, much higher than those pub¬ 
lished in the earlier paper cited; the range of talent in the former 
group being very much more curtailed. 

There is another possibility which must bo considered in accept¬ 
ing these reliability coefficients at their face value. According to 
our original assumptions, the reliability of the scale as a whole 
can only be obtained by the methods we have used in case the 
tests are correctly orott'ped into 'patterns in a proper manner. The 
low reliability which we have found might mean merely that the 
tests are improperly clasaihed at present. In this case, the true 
reliability of the scale (properly arranged) might be markedly 
higher than we have reported. Discussion.of this question of the 
grouping of the separate testa should be postponed until the inter- 
correlations of the tests have been presented. 

II The Internal Coherence of the Scale 

One of the crucial issues in the evaluation of the WilLTempera- 
ment Test is the matter of the arrangement of the separate ele¬ 
ments into the diagnostic patterns. As the authors interpret Dr. 
Downey's classification of the individual tests into groups which 
picture volitional patterns, it would seem that a valid grouping 
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would imply certaiTi mutual relation ships amoiig the tests. These 
are: 

(1) High scores in one teat of a pattern would be paralleled witk 
high scores in the other three tests of the same pattern. This 
is equivalent to saying that the inter-corrclationa between 
tests of a given pattern would tend to be positive and high. 

(2) Correlations between each test and the composites of the 
testa of the same pattern would tend to be positive and high. 

(3} The correlations between tests of one pattern' and those of* 
the other patterns would tend to be zero or very low. 

(4) Correlations between single tests and the total score on the 
scale would be low in all probability and not significant for 
purposes of evaluating the tests. 

In order to test these assumptions about the proper grouping* 
of the teats of the present scale, the correlations of each test with 
the composite (sum) of the other three tests of the same pattern 
have been computed. For obvious reasons the test used as one of 
the variables in the correlation must be omitted from the com¬ 
posite. Table 2 shows the obtained correlations. 

TABLE 2 

CORUELATIONS OF THE TESTS WI,TII THE COMPOSITES 


Teat 

Compesito 

r 

A 

B+C+D 

0.64 

B 

A+C+D 

0.28 

C 

A+B+D 

0.10 

D 

A+B+G 

0.39 

E 

P+G+H 

-0.08 

F 

E+G+H 

-0.23 

G 

1+P+H 

-0.13 

H 

E4-F+G 

-0.09 

I 

J+K+L. 

0.07 

J 

I+K+L 

0.33 

K 

I+J+L 

0.07 

L 

I+J+K 

O.OB 


The average inter-correlations of the testa within a pattern is: 
probably even a better method of testing the general validity of 
the grouping into patterns. Table 3 shows the results yielded by 
this method. 
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TABLE 3 

IXTKU'COIIUKLATIONS OF Till-} TKST.S OF THE SAME FATTEDNS 


Vdv'mbU 7 

Variable 2 

r 

A 

B 

0.3G 

A 

C 

6.28 

A 

D 

0,37 

B 

G 

-0.05 

B 

D 

0.33 

C 

D 

0.05 

Average 


0.22 

E 

F 

-0.05 

E 

G 

0.00 

E 

H 

-0.02 

F 

G 

-0.16 

F 

H 

-0.15 

G 

H 

0.01 

Average 


-0.06 

I 

J 

0.08 

I 

IC 

0,12 

I 

L 

0.00 

J 

K 

0,24 

J 

L 

0.18 

K 

L 

-0,18 

Average 


0.07 

G(jneral inspection of Tables 2 and 3 shows that the correlations 

between the separate 

teats are uniformly low, 

the second pattern 

(Testa E to H) being the moat unsatisfactory. 

It would be inter- 

eating to pick out from each pattern the best tests if this could be 
done easily. This would properly be done by multiple correlation 
methods and the labor involved would not seem to be justified by 

the general promise 

of the coefficients reported. In pattern one, 

it would appear that Tests A and .D would probably be found to 
be considerably superior to the other two. In pattern two, there 
is no promise that multiple correlation methods would reveal any-: 

thing of significance. 

, In pattern three., Testa, J and IC would hp- 


pear the most promising- 
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III Correlation of the Will Traits With General 
Intelligence 

Table 4 shows the correlations obtained between the scores in 
the twelve separate will testa and the averages of two standard 
group testa. The latter are the Termnn Group Teat of Mental 
Ability and the Morgan Group Mental Teat. The reliabilities of 
each of these tests is known to be well above 0.90 for ranges of 
talent comparable with those represented in the group considered 
here. The significance of the coeifleienta of correlations of Table 
4, like those of all of the preceding tnblesi is obscured by the 
fact that the leliabiUties of the aeparntc testa are unknown and 
are probably very low in many cases, 


TABLE 4 


CORIfELATlONS OP THE TWELVE WILL TRAITS WITH MEASUIVES 
OF GENERAL INTELUGMNCF 


Test 

A 

B 

C 

D 


r 

0.40 

0.19 

0.20 

0.16 


B 

E 

Q 

H 


- 0.03 

0.20 

0.11 

0.14 


I 

J 

K 

L 


0 > 1 & 

0.33 

0.34 

-0.06 


h^OTie of the above correlations is high enough to lend any sup^ 
port to the poasible criticism of the Downey tests as being meas¬ 
ures of general intelligence. The factor of intelligence undoubt¬ 
edly does enter into some of the tests but not to an extent that 
would invalidate the scale on this score. 

The inter-correlations between the tests have also been deter¬ 
mined independently of the influence of intelligence by means of the 
usual methods of partial correlation. Table B shows such pai^tial 
coefRcicnts. The notations ''rAC.i", etc., read: The cor¬ 

relation between traits A and B which Is independent of the in¬ 
fluence of intelligence, and similarly, for the correlation between 
traits A and C, and the others. 
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TABLE 5 

the rOURDLATIONS dktwebn tue separate traits wiiicn 

EXISTS IN depend ICNTliY OE THE FACTO 11 OF INTEIjUGENCE 
(OIITAINED 1)Y PARTIAL COnillOLATIONS) 


r r , r 


AB.i 

0.33 

FF.i 

-0.04 

IJ.i 

0.03 

r 


r 


r 


AC.i 

0.22 

EG.i 

0.00 

IlC.i 

0.07 

r 


r 


r 


AD.i 

0.34 

EII.i 

-0.02 

IL,i 

0.01 

T 


r 


r 


BCd 

^.00 

PG.i 

-0.17 

JK.i 

0.14 

r 


r 


r 


BD.i 

0.31 

PH.i 

-0.16 

JLa 

0.21 

r 


r 


r 


CD.i 

0.02 

GH.i 

0-00 

KL.i 

-0.18 


By referring to Table 4 again it will be seen that there has been 
little change resulting from the use of partial correlations in elim¬ 
inating the influence of the factor of intelligence. It may be con¬ 
cluded that whatever inter-correlation does exists between the 
various separate tesla of the saine patterns is not produced by 
the common factor of intelligence. The formula used in partial 
correlation is the usual one, following Yule's'notations: 

r — r r 

T 12 13 23 

12.3 ■ - - -■ 

I 2 i 2 

. / Lr l-r 

\ 13 \ 23 

IV The Validity of the Downey Scale 

The validation of any test of psychology capacities is at best 
a most difficult task. To this rule the Downey scale is probably 
no exception. For an account of the derivation of these teats the 
render is referred to the manual for use with the Will-Tempera¬ 
ment Scale*. 

In the earlier paper to which reference has several times been 
made, it was attempted to secure ratings' from competent Judges 
acquainted with the subjects oh each of the twelve traits of the 
Downey scale. A similar procedure has been adopted in the pres¬ 
ent study with certain modifications. It was thought that the 
teachers of the high school pupils under study might be able to 
furnish a set of ratings on -the twelve traits whicji would have 


“DoAvney, June 10:'“The WREProflle.’' University of Wyoming Bulletin, 
Vol XVI, No. ib, Novembor, IfiRI. 
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value as a criterion against which to evnUnite the tests proper. In 
adopting tEiis plan, the authors were by no means ignorant of the 
many pitfalls in subjective judgments. As shown in certain 
of the published studies, it is possible, at times, with snfbcioiiL 
care, to obtain reliable subjective cslimnLcs in the sen.se of high 
self-corrdation among the judges. However, high reliability, al- 
thoueh admittedly highly desirable for siicli purposes, does not 
guai’antoe that a valid evitevion has been built up. The question 
of the validity of such criteria is by far the more serious issue. 
The fact that ten persons rating a group of individuals for “ini¬ 
tiative/' “leadership,” or “tact” agree with a reliability equal to 
0,75 or higher means merely that they are rating the same thing 
or some other thing highly correlated with this thing, but it docs 
not follow of necessity that the ratings correspond to the psycho¬ 
logical functions which by hypothesis underlie the thing being 
rated. Teachers can furnish ratings on their pupils upon such 
traits as “persistence,” “conscientiousness,” “originality,” “hon¬ 
esty,” and a host of other traits with a fair amount of reliability, 
yet carefnl statistical analysis will reveal that little else is in¬ 
volved in these various separate trait ratings than the teachers’ 
general eatinoafces of the quality of school work being done by these 
pupils.. In other words, almost as good results could be obtained 
by asking for estimates of school work and then using these, in 
turn, as estimates of “persistence,” “originality,” “conscientious¬ 
ness,” etc. The estimates, then, are clearly not valid except as 
these traits are genuinely correlated with the quality of school 
work and even then it is a very indirect type of measurement. 

On the other hand what conclusious can be drawn from the 
situation of judges not being able to agree upon the presence ot 
absence of quantitative statement of paychological traits in a 
gi'oup of individuals known to the judges? Dogs failure to show 
self-correlation in chance halves of these sets of estimates carry 
with it any important implication? Does such a negative result 
with respect to a psychological trait prove that the trait in ques¬ 
tion has no true paychological basis? No universal answer can be 
given to these queries. In the case of many reputed psychological 
rubrics it probably does mean that there is no real evidence for 
aasuming the reality of. such traits aa true mental functions. In 
other cases if not in most the answer is left in an undeterminate 
status, i.e,, the experimental results are entirely non-committal in 
the sense that they furnish no evidence; positive or negative, upon 
the iesue of the existence or non-existence of bho trait in question. 
Even at this it might for all praotipal purposes ,be argued that 
Unless competent persons are in fair agreement about the presence 
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or absence of reputed psycho logical churacteristics there is no 
direct way of identifyizig sucli Ira its for pnr po.ses of study. 

With these limitations of the method of c slim a Los in mind wo 
can return to the discussion of the immediate problem. In the 
attempt to build up a criterion for purposes of correlation of the 
trait scores with n second measure of the same traits the high 
school teaclierii of the pupils in our jmL\sent study were asked 
simply to nominate the ten pupils in their classes who possessed 
the "strongest will-power" and the ten who had the "weakest will¬ 
power.''^ No attempt at further defiiiitioii of these directions was 
made. The reactions expected were those of the man on the street. 
The only outcome which was expected was that the pooled nomi¬ 
nations might reveal two groups widely spaced upon a scale of 
"will-power" in the common meaning of that term. When the 
nomination blanks were received it was found that certain pupils 
\vGre invariably reported in the game category. A larger number 
were about as often placed in one group as the other and a still 
larger number were never once nominated for either classification. 
There was, then, evidence of marked agreement in many cages, 
the total number of complete agreements being roughly 20 per 
cent of the total of one hundred forty-six pupils in the high school 
under study. Twenty-eight pupils involving equal numbers of the 
sexes and equal number.s in each of the two categories (i.e., "strong- 
willed” and "weak-willed") were selected for further study. The 
agreement was perfect or practically perfect in these cases in the 
sense that either three or four of the four teachers acquainted 
with every pupil placed him in the same category and no teacher 
.gave ft dissenting vote in any of these cnsca, The reliability coeffi¬ 
cient fox this final group was not determined but its general na¬ 
ture is assuredly high by virtue of the method of forming the group. 
Instructions were then sent to every teacher who had nominated 
any of the pupils in the final group to rate each pupil upon each 
of the twelve traits of the Downey scale. The trait descriptions 
were taken verbatim from the author's manual for use with these 
tests. 

The flhfl] group therefore comprised (to the b^at knowledge of 
:all of the teachers of the school) the fourteen pupils of the school 
showing the most marked volitional characteristics and an equal 
number most lacking in these same characteristics. As well as 
eould be done by estimation we had segregated the highest and 
lowest t6n per cents-of the group ns a whole. Table 6 shows the 
correlations found between the pooled eatimates of the teachers 
and the test scores in each of the twelve traits. Inspection of 
these coefficients of correlation does not reveal very definite evi¬ 
dence of the ability of teochers to identify the various traits tested 
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by the Downey scale. Whether this situntion can be interpreted' 
aa meaning tliat the Downey scale is of doubtful validity is very 
queationuble. A eaner conclusion would be that teachers are un* 
able to identify the traits of the Downey scale in their pupils to 
any considerable extent (traits J nnd K, and possibly traits A 
and C being apparent exceptions). It ia probably fair to assume,, 
however, that the Downey tests cannot be validated by the method 
of subjective estimateg with any high amount of ngsuranee. The 
correlations between estimates and test scores are in general of 
about the same magnitudes as those reported in the earlier study 
(where the range was from -0.33 to 0,61 for the pooled estimates 
of three or four college professors; the average being 0.07). Tho 
average estimate-test correlation ia 0.16 for Table 6. 

TABLE 6 

COnilBLATIONS tUmviiJEN BSTIJrATES AND TEST SCORES (N=2fl) 


Trait 

r 

Trait 

r 

Trait 

r 

A 

0.37 

E 

0.19 

I 

-0.09' 

B 

0,02 

P 

-0.03 

J 

0.51 

C 

0.30 

G 

-Q.04 

IC 

0.63 

D 

-0.20 

H 

0-17 

L 

0,17 


The probable errors of the coefficients of correlation in Table 6- 
can be found in Table 7 to a sufficient accuracy for our purposes. 
The same ia true of the correlation coefficients given in Tables 1 
to 5. Except in Table 6, the numbers of cases have invariably been 
one hundred and forty-aix> 


TABLE 7 

A HBFKRENCE TABLE ' OF PROBABIjB ERRORS OF PEARSON CO¬ 
EFFICIENTS OP COJIK0LAT1ON FOR VADOBS OP r 

abpeauing in the foregoing tables 


r Probable Erors of r 



N=146 

1^=28 

0.00 

.056 

.127 

0,05 

.056 

.127 

0.10 

.065 

.126 

0,16 

-OBE 

.126 

0.20 

.054 

,122 

0.Z5 

.052 

,120 

0.30 

.051 

.116 

0.36 

.040 

.112 

0.40 

.047 

.107, 

0.46 

.046 

,102 

O.BO 

.042 

,096 

0166 

.038 

.080 
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CONCLUSIONS- 

The following points nve suggested as summarizing the more im¬ 
portant findings presented; 

(1) The reliability of the TPoiaiiey Groitp WHl-Tcmperdment Tent 
is probably not higher than 0,40 ns an estimate of the corre¬ 
lation which would be found between two similar forms of the 
tests were n second form available. It is no doubt true that 
certain of the patterns are more I’eliablc than others, a fact 
which militates against the reliability of the sonic as n whole. 

(2) The validity of certain of the individual testa is doubtful. The 
iuter-correlationa in paLterna II and III are low, pattern I 
being the most satisfactory, The same situation holds for 
the correlations of the individual teats with the composites of 
the remaining teats of the aome pattern. 

(3) The lack of inter-correlation between tests of the same pat¬ 
tern in the case of pattern II, and to a leas degree in the 
other patterns, may be due to either: (a) unreliability of the 
individual testa (not determined in this study), or (b) faulty 
location of cert'ain tests. In the latter case further study 
might suggest changes from one pattern into another. 

(4) There was found no reason to believe tiuit the Downey teats 
measure merely intelligence. The inter-correlntions, where 
they are aignificnlly high, arc not due to the common factor 
of intelligence. 

(5) The attempt to validate the separnte tests of the scale by 
means of teachers^ judgments yielded ambiguous results, It 
would appear that strict vnlidation of the Downey tests by the 
method of estimntcd would be a very difficult task. We can 
conclude that, with n few exceptions, high school teachers 
cannot identify the psychological traits measured by tlie 
Downey teats by atudy of the characterizations of those traits 
which have been published by the author of the tests. It 
should be pointed out that the estimates used in this study 
cannot be assumed to be valid, although their general relia¬ 
bility is doubtless satisfactorily high for purposes of a rough 
criterion. The question of the validation of the Downey tests 
can better be dismissed by refering the reader to Dr, Downey's 
manual, previously cited, for a discussion of this point. 

(G).In general there nve a considerable number of testa in the 
Downey Will-Temperament Teat that show promise of lending 
themaelvca to further study and development, Duplication of 
such tests and probably a number of substitutions will lead to 
n more valid instrument for the measurement of volitional 
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traits. The urgent need for such measurements demands that 
the pioneer efforts of Dr. Downey be rewarded witli the rec 
ognition that much promising ground had been broken bv hsr 
patent investigatiohs and that fm-ther progress has been 
made possible m this direction. 



the freshman : THORNDIKE COLLEGE EN¬ 
TRANCE TESTS, FIRST SEMESTER 
GRADES, BINET TESTS 


By W* T, Root, 
Uiiivorsily of PiltsburE^h. 


{NTROOdCTlON, A.t Lhc bcginiihij' of the acudemic year, 
1921*22, t)u5 CoJloi^t' of Llui Univcraity of Pittsburgh* gave the 
Thorndike Intelligence Examination for Iligli School Graduates 
to n Freshman class of The tests given were: Part I, Form 

I (designated aa Tl) ; Part I, Form M (T2) ; Part II, Form D 
(T3); Part III, Form D (Td), The total, that is the sum of the 
four tests, is designated Tb, The test y/na given without inter¬ 
mission other than the short intervala provided for in the in¬ 
structions. 

Results. Tile following nvcrngcfl were secured: 


Test 

Average 

Tl 

lOb.119 

T2 

105.27G 

T3 

101.604 

T4 

32,97 

T5 

341.61 


Final score (T5 divided by 5) G8,38 
Median score, 70 
Range 21 to HO 

Con*c/at! 07 i 8 between different forms. The forma were correlated' 
with the total singly and in combination: 


Test 

r (Pearson) 

P. E, 

T5 with Tl 

.848 

.007 

T5 with T2 

.829 

.009 

TB with T3 

.904 

.006 

T5 with T4 

.754 

.01 

TB with Tl plus T2 

.914 

.004 

TB with Tl plus T3 

.960 

.002 


’The Di'pjirtmrmt of PKYcliolOKy iind scored UiR teats. Tlie writer 

la III dob tod to cho jjnuliinio stiiaontH In pHycbology for miiiiy wenry hours, 
□r uliiUbLlcrtl calc II 111 lion- Knnolal iickiiowledpmeut la duo ProfoBaor loiorence 
TeiiKiirdcu for IriinHUlutlnp i;raLloH Into alRjnn vuIuch and for giving the 
IJinot Ti'Ht-s to tin* h'l-eHliiiitin twirls. iMvh. Idii Nyee Uwot 1« to ho thnnlied for 
many ilnya Knont Jji the voAiilloiis UihIc of KtiitlHllcnl rcchcckliig niul oC 
ferreting out (‘rrorn, 
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The high correMion of Tl plus Ts with T5 suffjeets ve)y 
strongly t,hat T2 tmd Ti 6e elmmated in future toating. This 
‘lOoiild mean a great economy in the time required io give the test, 
■in the time required to score, and in the cost o/'tost materials. 

Correlation of TS soiih the academic grades for the first semes¬ 
ter. In attempting to summate the academic grades the writer 
met with the usual dilHcultiea. It seemed best after all factors 
were considered to resort to the tedious method of transmuting all 
grades to sigma values thus correcting for the great variance in 
distribution of A's, B's, C’s, D'a, and P’s. The sigma value was 
weighted according to the number of units of credit the coui'se in 
question carried. The weighted aigma values were added and 
divided by the number of units of credit carried by the particular 
Freshman in question. This procedure overcomes the injustice 
usually experienced by students carrying ’'stiff” courses (i.e., 
courses with a high percentage of D's and P’s and a low per¬ 
centage of A's and B’s). The sigma values of A, B, C, D, and P 
were determined for each subject taught to Freshmen. D is the 
lowest passing grade while P is failure. 

The conelations between the academic gr-ades and the Thorn- 
• dihe forms are as follows: 


Test 


r 

P-E. 

Tl 

with grades 

.42 

.02 

T2 

with grades 

.33 

.03 

T3 

with grades 

.36 

.03 

T4 

with grades 

.415 

.02 

T5 

with grades 

.61 

.02 


The Thorndike total was now correlated with each college sub¬ 
ject taken by the Freshmen, debarring a few in which the number 
of beginning students was too small to admit of correlation. {Tab¬ 
ulation I) 
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The correlations are moderately hig^h and considerable aienifi- 
eance aa N is large in the majority of cases and the group is 
homogeneous. The correlation of the Thorndike test ^vith Human 
Progress is conspicuously high (r. .GB9) with a very small prob¬ 
able error (P- E. .01). Th's course deals with a large number 
of the arts and sciences in a semi-philosophical way. The classes 
are large and a premiuni is placed on goneral information and 
linguistic ability. English 1, Graphics 2, Mathematics 21 and 
French 1 correlated less highly than the other courses with the 
Thorndike total- English may be a mottor of home conditions, 
foreign parentage or drill and follow up work through four years 
of high achooL The students enter Graphics and Mathematics with 
very different preparations'; French may be very easy for the stu¬ 
dent with a fair knowledge of Latin or one of the Latin languages. 
If Italian is apoken in the home it may prove to be n hinderunce 
in an English course and a boon in a French course. One may 
speculate indefinitely as to the general causes for correlation or 
non-correlation. 

The x^Togiio^iic value of the Thorndike College Entrance Teste. 
It is possible to have reasonably high correlations without much 
justification for applying the findings to nn individual case. Dis¬ 
tinct sets of causes may be at' work: thus, we may have nearly 
perfect- correlation with a portion of the cases, a moderately posi¬ 
tive trend for a large median group, with a significant group sho'w- 
ing a negative correlation. Again, we may have marked negative 
or positive correlation in certain regions of the data with an in- 
difTerent correspondence in other regiona. It becomes pertinent, 
then, to ask for an anafi/aie of the tendency to correlation or rank- 
correapondence se well aa to compute the coefficient of correlation. 

The chief reason for administering the tests now under consid- 
.eration to Freshmen is to predict their capabilities in connection 
with academic college requirements. It therefore seemed desirable 
to rate the Freshmen in some form of grade claasitication, ar¬ 
ranged in rank-order, and to compare this ranking with the Thorn¬ 
dike rank-orders, The cdnventignal distribution of grades over a 
±3*1 normal distribution curve is, perhaps, as good as any. The 
data can then be tabulated as follows (A, B, C, D and F I'eferring 
to grades and a, /37 and e referring to. precisely the same per¬ 
cental divisions in the descending rank-order arrangement of the 
Thorndike totals) : 



A or a 

B or p 

G or 7 

D or 6 

F or E 

%. 

.... 3.B 

24 

45 

24 

3.5 

No; cases.... 

.... 20 

137 

265 

137 

20 
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The college grtidea me expreased as sigma values and each Frcsh- 
mnn's rnnk-ordcr is determined by dncliiig his average sigma (the 
sum of his weighted sigmas divided by the number of units car¬ 
ried). Thcie average sigma value.'? arranged in de^jcending rank- 
order arc then ready for comparison with the covref^pomling rank- 
orders in the Thorndike te.sU. If the Thorndike Lost is prognostic 
of academic ability then the 20 Btiidents composing the A group 
should have a nink-correspondence such tis to place the majority of 
them ill the « gi'aup (tlic 20 ranking Jiighest in the Tliorndiko 
group). Tabulation II prosonts the rank-orders for college grades 
anti Thorndike scores for conipurison and nniily.sia of the rank- 
correspondence in dilTerent percental regions of the rank-order 
aerica, The question i.s: Does the Thorndike Test performtmee 
anticipate the quality or approximuLe quality of college work a 
particular Freshman will do? 


TABULATION II, 



A 

B 

C 

D 

F 

TOTALS 

A 

4 

1 

9 

£ 

7 

9 

0 

5 

0 

20 

B 

7 

• 

60 

33 

54 

61 

1 ( 

33 

5 

6 

137 


m 

62 

61 

115 


5 

a 


I 

n 



53 

33 

7 

5 

137 

B 





3 

l' 

20 

-1 

\ 

\ 

m 

IS 

m 

IS 

20 

569 
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The'following observations may be made directly from the tab¬ 
ulated data: 

1 , No. ft's are ranked D or F in academic standing, 

2 , No. e's attain A ov B standing, 

3 , But of those making A standing, only 1/fi are a'a and the 
largest number are drawn from the y group. 

4 , Had superior scholarship been predicted by selecting the 
ft group we would actually have secured 4 A students along with 
9 B students and 7 C students. 

h, 80 of the 157 students comprising the A and D groups aro 
in the « and p groups. 

Seventy-one of the 1B7 compriging the D and F groupg are iu 
the 3 and e groups. 

That is, the upper 27,5of the Thorndike rank-orders would 
have been somewhat selective as regards academic attainment. 
Had the e group been taken ns a basis of entrance exclusion, it 
would have resulted in the excluding of 8 D students and 9 G 
students out of ft total of 20 e students. 

6 . Had the college wished to maintain very high standards and 
bad excluded 5 and e standings, it would have excluded 79 C 
students, 6 B students, and 1 A student out of a total of 167 
Freshmen. The Thorndike ranking would have correctly placed 
71 (that is 9 -£*s who are in corresponding academic rank-orders, 
namely the D-F groups), while random choice alone would have 
correctly placed 44 of these, 

7. On the other hand, if the groups bad boen used as ft 

basis of initial retention in college, 86 D and F students would 
have been admitted into the Freshman class against the 71 D and 
F students excluded in the fi-c's exclusion. Chnneo alone would 
have given us 114 D and F grade Freshmen, out of a total of 
410 a-^-y’s. 

Of the 569 students chance alone would have given 157 DF's. 
Had the 5 -e groups been arbitrarily excluded (and the 
grqups retained), 71 D-F students would have been excluded and 
86 D-F included. But 86 A-B-G students would have been thus 
excluded. This would give a total of 176 improper inclusions and 
improper exclusions or 19 more than the improper inclusions 
chance alone would have given. 

8 . There are five comparable groups, <t-A, ^-B, y-C, fi-D, and 
«-F. Of these groups, the y-C ja the only one that is largest fqr 
the column in question. In this case it is totally without prog¬ 
nostic significance as chance alone would have placed 115 G's in 
the 7 group. It should furthermore be noted that the distribution 
of C students through a, /3, 5, y and e ig about the diatribution 
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chnnce would have pivcn. And likewise the row has a close-to- 
chftncD distribution througli A, B, C, D nnd F. Hence for a stu¬ 
dent to be in the 7 group argues nothing ns to his ncademic vnnk- 
ordor; nnd vice versa, C grades run the gamut of a near-chance 
diatribiition curve from a to 

Deducting from ouch of the live comparable groups (A-«, 
otc.) the number of cases that would fall in these groups by 
chance alone, gives the number of cases precisely located in n 
correspoiiding rank-order. Wo hnvo; 

Of 20 ti’s, 3 A's or 1B% in precise corresponding rank-order. 

Of 137 ^' 3 , 27 B^s or 1995? in precise corresponding rank-order. 

Of 25B 7 ’a, none. 

Of 137 fi'a, 20 or 16% in precise corresponding rank-order. 

Of 20 ff's, 2 or 10% in pi^ecise coi'responding rank-order. 

9. Compiling ft, 7 and 6 we have 529 cases, comprising 128 B\s, 
246 C's, and 129 D's. Thus the Thorndike testa would have cor¬ 
rectly placed 12 more .subjects than chnnce alone or about 2 per 
cent of the total number of students in the combined ft, 7 and 5 

gl'OLipS. 


TABULATION III, 



Q 

B 

Di 

B 

B 

B 

B 

B 


Q 

fl 

B 

B 

B 

B 

B 

B 



§ 

6 

m 

B 

B 

Bl 

B 




0 

B 

B 

B 

B 

B 

P Scores 50 to 60 

B 

fl 

1 

B 

B 

B 

B 

B 

p. Scores under 50 


B 

B 

B 

B 

B 

B 

B 


AN ANALYSIS OF TIIOIINDIKE’S GROUPINGS 

Thorndike attempts to prophecy on a basis of the absolute 
scores received. He makes the following classification: 

"A boy scoring over 96 is worth admitting in almost entire dis¬ 
regard of technical deficiencies. 

A boy scoring 85 to 96 has intellect enough to do collegiate 
and professional work with distinction. 
A boy scoring 70 to 86 has intellect enough to do the work to 
obtain a college degree. 
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A. boy acorin^ 60 to 70 Jiiay be admitted if he is sufficiently 
in earnest and otherwise desirable. 

A. boy scoring 60 to CO should be admitted only if )ie is of 
extraordinary zeal or has Buifored 
very groat ethicational handicaps. 

A boy scoring under BO should not be admitted." 

The accompanying tabulation (HI) follows Thorndike's group¬ 
ing. The academic grade rank-orders have been arbitrarily 
classified to agree in rank correspondence with the Thorndike 
classification, 

Conclusions i 

1 . None of the Thorndike A group falls in the corresponding 
academic group a (the 9 highest academic rank-orders); however, 
none falls in the lowest academic groups, e and f. 

2. Likewise none of the F group falls in the academic a or b 
groups. 

3. The students composing the a group came chiefly from the 
C group. 

4. Taking Thorndike's G group as the dividing line for in¬ 
clusion in or exclusion from college entrance, one would include 174 
correctly but also 93 incorrectly, (students making d, f, and e 
gi^adea). On the othei' hand, the elimination of the D, E, and F 
students would have excluded 93 students who are doing v/ork 
in the a, b and c groups. Thus there would be 186 improper in¬ 
clusions and exclusions in using Thorndike's A, B and C gi'oupa as 
an inclusion basis against 209 proper exclusions. Out of 5G9 
students 302 would be excluded. It must be recalled that in ex¬ 
cluding such a large percentage of the students seeking admission, 
chance alone would have correctly excluded 161. 

6 . Excluding E's and F^s would retain 85 of the upper 
Thorndike groups doing no better work than E's and F's, and 
would exclude 8 B E’b and F's doing work on a par with those 
admitted. Granting that e and f grade work warrants exclusion, 
we have 74 proper exclusions, and 170 improper inclusions and 
unjust exclusions. 

6 , Let us take Thorndike's lowest group, F, (scores below 60), 
which Thorndike categorically asserts should be excluded. Of the 
03 comprising this group 48 do work on a par with TOany in the 
retained groups, while 48 in the retained groups are doing the 
same quality of academic work as those excluded. Thus we have 
96 improper exclusions and inclusions, and 15 proper exclusions, 
.7, Tabulations II and III lead to the same general conclusions. 
While the coryveldiion between pTades wnd Thoi'ndike scoves is 
Teasonahly hiffh^ an inspection of the differences in raiik-oj'der 
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egmspndmc mltcnlcn lltnl ii/crif hiJiiAliri; wonld be done, both 
hi «wi ca'r/HfliriJis, lucre Ihr entrnner tests used as ft 

iflsis of colleffe adniminii, .In noliwf jimclirc the lines of de- 
simalion belwcrn //roii/m tire ton i7ly rff/iiicrf to wiiriwit such 
imlic (idion as off-hnml e,‘‘clusion from colle[jr. IJowover, the 
Ireiul of correlalion is suffiricnll]/ strimi/ to far siir]ms any im¬ 
pressionistic ciitimdfe and llic tests skniild eonsliinic an ciceellonl 
basis for the Initinl amtlj/sis of ruses, iiml for judicious use in 
ttlletiipUnir to size up h-i'slmen failures. Whether the iimss test 
13 more triil]/ prophetic of final collei/c success than the combined 
esiiinalos of dozens of niainictoj's after secen/oen wcek.s contact is 
(t specidailife matter w/iic/i can be decided only by foUoi</-up work 
for 0 TinmJifl?' of years, 


EXTRtm UPI'BII AM> MMV'Bll IiA\K-<)R/lHH.S IX OIJIil.KGE BN- 
TRANCR TKHtrt COMl’AURU A« TO I'KllFOIlMANOl'] 

IN niNUT TI'ISTH 

Forty of tlio upper ronk-orders of the Thorndike Teat (Ito 58 
inclusive) and alno 40 of the lower rank-orders (479 to 569 in¬ 
clusive)’ were given the Biriet TestsF The uccompanying 
tabulation (III) shows deorly that the correspondence between the 
two testa is extremely cloae, quite in contrast to the vague cor¬ 
respondence between t)ic Thorndike and the academic standing. 


’Innblllty to nrrfiiitfo n lime snltjible for both llic student nod the cx- 
BDilner rItIdi; tlie lllnct Tost, made It ncecRsary to fo below rank <10 and 
above riiiik 021) lu llie lower Hroiip. One of the lower rank-ordera waa 
ollmlnoteJ. The Aubjeet, an ln(clll|;cnt Itiillao Just learning: the l&nffUR^o, 
relUBcd to try Um IlliiH Tent niter dulnir Ibc vocabulary, 

•The Ktudent nppoIjilincjilH for tlic Ulnet Teats were nrranBcd tbrouBh 
Itio co-opcratlon of ProfcHHOr H, P, Anho, Frealinmn Advisor. 
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TABULATION IV 

Binet Teats Used as a Basis for Compnrine the Extreme Upper 
and Lower Rank Orders of Thorndike College 
Entrnnce Tests 

40 highest 30 lowest 
Rank Orders Hank Orders 

Chronological age raTiee.,«v.«.i«.4..i 22-8 to 27 to 18-2 

Chronological age modi an. 20-1 IS-5 

Mental age range... 10-6 to l7-2 18 to 12-1 

Mental age median...... 10 15-5 

Vocabulary range.,...,.ilG,8G01ol2|780 12,600to 6,840 

Vocabulary median. 14,940 

Number failing 

XVni Superior adult vocabulary..- 5 

Binet's paper-cutting test. 

Repeats B digits... 13 

Repeats thought of passage..,. 

Repeats 7 digits backward. 

Ingeiiuity test. 

XVI Average adult vocabulary. 

Interpretation of fables—. 

Difference between abstract 

words . 

Problem of the enclosed boxes. 6 

Repeats 6 digits backwards. 1 

Code . 

XIV Vocabulary 60 words. 

Induction test .. 

President and king... 

Problems of fact. 

Arithmetical reasoning. 

Clock .. 

XII Vocabulary 40 words. 

Abstract words..... 

Ball and field.-. 

dissected scYvtcwcftS. 

Fables . 

Repeats 5 digits backwards. 

Pictures interpretation.. 

Gives similarities. 

X Vocabulary 30 words,,,,.... 

Absurdities . 

60 words ... 

Total No. of teats failed......,...,.,.... 44 


12 

8 


10,260 

39 
2B 
24 
26 
31 
31 
30 
lb 

11 
22 
17 
23 
8 

7 

8 
:o 

9 

s 

1 

4 
3 
1 
3 
1 
1 

1 

2 

361 
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The lower f^roup is iimdc up of older students mul it may be 
added hns more of foreign birth and foreign family. It is a 
nintter of general observation that older persons show less as¬ 
sociative plasticity und speed. 

Concerning I. Q. mid meiitiiL age: 

8 of the lower group had L Q.'s 100 or more. 

31 of the lower group hud L Q.’s less than 100. 

3 of fcho lower group hud mental iig'o.s of 12(11-7 to 12-G) 

5 of tlie lower group had mental ages of 13(12-7 to 13-G) 

4 of the lower group had mental ages of 14(13-7 to 14-G) 

8 of the lower group had mental ngea of 15(14-7 to IG-G) 

12 of the lower group had mcMital ages of 1(5(15-7 to lO-G) 

4 of the lower group had mental nges of 17(16-7 to 17-C) 

2 of the lower group had mental ages of 18(17-7 to 18-C) 

In the upper group the lowest 1, Q. was 104. Nineteen failed 
in the high adult digits Losls; 7 failed in both, 14 passed all of 
tho test.'j; 13 failed 1 test? 11 failed 2 lusts; 1 failed 3 lusts; and 
1 failed 5 tests. 

The fact that 25 of tho 44 failures in the upper group wore digit 
tests indicates thai the digit tests (counting an entire year of 
mental age) are entirely out of proportion to their importance in 
determining mental age. A careful study of the individual casoa 
gives little evidence thiiL immediate verbal auditory memory span 
for digits is of any marked value in determining superior intelli¬ 
gence. It is a matter in which there is marked individual dif¬ 
ference in adults with slight reason for believing that there is a 
corresponding intellectual dift’crcnce. 

UG(idhi{/ ti}id Vocuhfihirj/. The most striking contrasts be¬ 
tween the groups is in the vocabulauies and reading Imbits, The 
highest vocabulary in the low group is less than the poorest vocab¬ 
ulary of the high group. 

An attempt was made to got at the reading habits of the 
groups under consideration, A rough rending scale was impro¬ 
vised, scoring ns follows: 

1. Readers of critical and difRcuIt literature. 

2 . Superior readers, read classical and good current literature. 

3. Average readers. 

4. Readers of newspapers And sport news. 

6 , Roaders who do almost no voluntary reading being nearly 
devoid of a reading habit. 
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Tabulating for the two groups Ave hnYe; 


Rending 

Number in 

Number in 

Rank 

High Group 

Low Group 

1 . 

.. 6 ... 

.. 1 

2 . 

... 12 . .. 

. . . . 2 

3. 

.15.. . 

.-.. 7 

4 ... 

.. 7 ... 

.-. 14 

6 ..-,... 

. . . 0 . 

.. Ifi 


The contrast here is very marked indicating decided lack of 
reading habits in the lower group, 

TABULATION V, 


Cases With Marked Inconsistency in Performance in Upper and 
Lower Groups 


01 

35 

u 

B 

G 

V 

u 

o 

^ d 

lUQ.MAUKS 

o W 

R 5 

^ s 

V 

a ^ 


A i> 

01 rt 

4) rt 

0 

to 








3 

386% 

3 

91 

10 

Out of school 3 yrs. Trig. & Physics 

5 

132% 

2 

92 

19 

difficult 

a 

137 

3 

92 

19 


B 

188% 

1 

66 

18% 

Out of school 3 yvs. Indifferent to 

10 

107% 

2 

83 

19% 

grades 

Exemption grades in H. B. 

13,B 

188% 

3 

81.B 

10 


20 

297 

1 

87 

19% 


27^/^ 

223 Va 

2 

79 

19 


30 

197 

1 

90% 

19 


36% 

6B4 

2 

88 

19 

Absent one month in first semester 

3B% 

301% 

4 

84 

19% 


40% 

542 

2 

81 

18% 


48% 

360% 

3 

73 

18% 


68% 

268 

4 

89.5 

17-? 


622 

283 

3 

68 

la-Q 

Italian. Foreign parent. 

524 

71 

2 

56 

16-5 

Jewish, Soho diatrict. 

526 

172 

2 

07 

15^8 

Jewish- Foreign parent. 

506% 

290% 

3 

70 

17-1 

Attj&ndcd sixteen different achoola. 

5B8% 

249 

4 

62 

10 


546% 

267% 

5 

40 

14^9 

Italian, Foreign home. 

553% 

264 

5 

63 

1341 

J,ev(ist. 

664 

208% 

4. 

70 

174 

Jewish- 

667 

157% 

5 

48 

12-2 

Negro. 

661 

206 

4 

68 

18 

Gommutea four hours daily. 
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Analysis of cases shaiuiuff marked contrasts in performance. 
It would have been hijfhly dcfsirnble to have studied the social 
conditions suLToundin^ these Ftoshmen composiuB the upper and 
lower groups. This was impossible, due both to Inch of time 
Bnd to the diffidence on the part of students concerning their 
social and economic status. Nevertheless, after personal inter¬ 
views with the atiidenba in question, it is possible to throw some 
light on the marked incDnsistcncics in teat performance and 
academic rank, presented in the nccomponying Tabulatjo)i V. 

('ONCLUSIONH 

1 . A high Thorndike rank is accompanied by a high Binet 
score and large vocabulary; and vice versa, a low Thorndike score 
by low mental age and small vocabulary, 

2. But high vocabularies are not necessarily found with a 
superior reading ranking or vice versa. 

3. Of the 40 in the upper Thorndike group, 14 are distinctly 
below any corresponding academic rank-order, while 7 fall below 
tlie median rank-order, 286, of the entire Freshman class, 

4. In the lower group just the opposite is found; with low 
mental age, low vocabulary and low entrance examination score ia* 
found a relatively high academic rank-order. Of the lO cases, 9 
have academic ranks above the median rank-order of the Thorn¬ 
dike scores. 

6 . The cases showing marked inconsistencies constitute nearly 
1-3 of the total number of the 79 cases studied intensively. 

6 . It should also be noted that in spite of exceedingly low vo¬ 
cabulary and mental age, cases 522, 653U, and 567 make more 
than median grades. 

7. In the lower group, 6 are either Italian or Jewish, In all 
of these cases, and many more not presented here, the parents 
speak a foreign language. Is it not to be expected that an English 
vocabulary and tests resting on the niceties of English idiom 
will suffer 7 

8 . Absence during the semester and a several-year gap be¬ 
tween high school and college seem to be the moat obvious and 
plausible explanations in certain cases of relative academic in¬ 
feriority in the upper group. 

9. The negro, case 667, unlike the Jewish and Italian tnsps, 
appears very dull. Ho is carrying, however, a very heavy pro¬ 
gram including mathematics, physics and chemistry in which he 
la making more than median grades. An examinotion of the per¬ 
centage of A'Sj B's, C'a, D'b and F'b given in these courses indi¬ 
cates that they'are not “pipe courses,'* (see Tabulation I), In the 
opinion of the writer the explanation is thiaj The student has 
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had an excellent high flchool training ^vith n careful drilling in 
technical courses that dovetail into the courses taken in college. 

It is doubtful if the chap \vill long inaititaiu an academic ranking 
of 157% against n Thorndike rank of 567 and a Binot mental 
age of 12-2. 

10, The personal interviews elicited the following, at least 
plausible, explanations for the marked rank-order difference be- 
tvveen academic grades and the Thorndike bests; 

(r) Some students arc capable but mdiiferent to griules, tend¬ 
ing to follow an interest rather than make punctilious preparation 
of daily tasks, Case 8 is a good example. In the opinion of the 
writer, the Thorndike test places him more nearly correctly. The 
chap has been out of school three years between high school and 
college, which is perhaps a contributing factor, but the chief 
dilBcnlty is that he has very positive ideas concerning academic 
values and refuses to fulfill, what he considers to be, petty class¬ 
room demands, He has already been successful iu'the work-a-clay 
world. 

(b) Outside work, undoubtedly, in many cases makes for 
poorer grades, 

(c) Commuting tends, also, to produce a poorer grade of work., 
than otherwise, 

(d) The character of the high school work plays n largo part 
in the character of the Freshman college work. For example, one 
high school, gives to its seniors a course on Cun'cnb Literature. 
AlFof these students show a relatively greater general informa¬ 
tion thnn the average high school graduate. Another high school 
apparently gives unusual work in science and mnthenaatics, One 
of the students from the lower Thorndike group, with good grades, 
stated that the physics and mathematics he ^was taking were 
almost entirely review. Again, a student changing from a literary 
or a scientific course in high school to a .scientific or literary in 
college is greatly handicapped over the one who hna had a con¬ 
stant vocational objective. All considered, atudentg who have 
established good habits in mathematics, science, laboratory and 
English composition, regardless of their native endowment, have 
an advantage over those who have not. 

(e) Unusual zeal for learning, and persistence txvark the at¬ 
titude of many of the foreigner's. Especially the Jr^wa. The greater 
the economic and ,cu'ltur(il handicap, seeiningly, the greater the 
zeal. 

Xn might elaborate Indefmitely, but this is su^clent to 

indicate that ^ careful study of tlie individual case ia tho next 
step fl^ter the rougli grouping of^ a mass intGlU^cnce lest.. It. ia 
much easier, and far more satisfying, to deal in broad statistical 



THE FRESHMAN COLLEGE ENTRANCE TESTS 91 


trends than it is to tease out the vexatious probleinB of individual 

causes in variation*-But, the latter is the next logical step in 

testing. 

11 , Errors in grading undoubtedly play a part in the rank- 
order differences between the Thorndike rating and the instructors 
rating* Impreasionistic methods of grading, marked bias in 
weighting certain qualities in work and too few facts for eatimqte 
often cause the inatructor^a grade to be a long way from the 
absolute facta. 


CONCLUSIONS 

1. 'While there is a fairly high correlation between academic 
grades and the Thorndike tests, upon analysis the approximation 
is found to be too rough to permit exclusioji, inclusion, or the 
assumption that the highest test group (above 96) is peculiarly 
superior. 

2 . Nevertheless, the college entrance tests are not without 
merit, offering ns they do, an initial point for analysis and 
judicious prognosis, but unfortunately, not scientific prophecy. 
Such tests are undoubtedly superior to any impressionistic esti¬ 
mates of the Freshman. It becomes necessary, however, to fol¬ 
low up the test findings with a careful analysis of the qualitative 
character of the score; to supplement with a common-sense in¬ 
vestigation of the nature of the high school training noting how 
well it dovetails into the curriculum of the particular student in 
question* The home, language, zeal, outside employment, and so 
on must be weighed and evaluated, The tests form but -a part of 
a complex differential diagnosis. All factors must be carefully 
aummated analogous to n court's getting a perspective on cir¬ 
cumstantial evideTice. 

3. “Whether the student is surpassing or falling below the 
Thorndike 'rank-order, he is equally of interest. At present such 
cases demand an investigation to "show cause," 

4. Not only is the Freshman up for critical study and evalua¬ 
tion but the test purporting to evaluate him is equally on trial to 
show it has value. 

6 . A combination of Part I, form 6, and Part III, form D would 
probably be as valuable ns all four forms; thus enacting a saving 
of 60 per cent in giving, scoring, and purchase price of blanks. 
But it should be added that for purposes of analysis, much is to 
be gleaned by a study of the qualitative character of all four 
forma. 
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6. The lank-oi-der comparison between the Thorndike tests and 
the academic grades should be continued throughout the colie! 
course, At present any assumption ns to the sunerL nr!S^ 
value of the mass intelligence test over the Preshinnn’s ae/ifin 
performance, is speculative and idle. ^ 



the UNRELIABIIHTY of M. a. and I. Q. BASED 
ON GROUP TESTS OF GENERAL 
MENTAL ABILITY.’ 


hy Authur I. Gatks 
T cnchora Colk'gu, Columbia CnivcTflity 


The ijracUce oC compuUn}? moiital aj?c8 and liUulligcncc 
Quotients from seoi’es of t^roup tentu of K:cnei‘fll inonlfll ability lina 
been questioned recently on theoretical ffiouiuN,^ and various 
worker's avii discoverinft’ llio unreliability of these ineasures by 
comparing the rcsidU obtained from dilTeront tests.^ This paper 
presents data which show that at least under certain conditions, 
quite ridicidoua IQ'h may be derived from certain group tests. 

Tile following- testa were given on successive days to the pupila 
of Grades I to VIII inclusive of the Scarborough School: Dear¬ 
born, Examination I or II, Haggerty, Delta 1 or II, Holleys Pic¬ 
ture Completion or Sentence Completion, Illinoia (III to VlH 
only), Otts Primnry or Advanced, National Intelligence, Forms A 
and B, (III to VIII only) and Moyers Alental Measure. The 
Stanford-Binet was given during the year to Grades I to VI 
inclusive. 

The tGak.s were given to groups of twenty or leas and particular 
attention was given to time, instructions, provision with pencils, 
etc. The pupils had learned to take tests earnestly and we are 
confident that the test conditions in general were more uniform 
and satisfactory than will be obtained in ordinary school practice. 
The results were scored by an expert. 

The msnUl ago of the scores on the several tests 

were computed by use of the ago norm lablea accompanyine each 
tost.* In most cases the line describing the median age score -^.vas 
extended to cover such of our scores as exceeded the highest age 
norm given. From these data, IQ^s were computed. 

Table I, which gives the data in detail for Grade I, illustrates 
the treatment of results, The horizontal lines give the facts for the 
several subjects; the vertical columns give the facta for the class. 
Columns 1 to 0 give the IQ^s which are summarized at the foot in 

'ThlH Htndy la (i eoiUi'lluUiou o£ Llio Doiuii’hiiont of Ediieutloiml llOBciii'ch, 
SciirlKU’Ouff)! School, t^cnrnoi'nu/yh, jNov Ynrli, 

*F. N. L'l-oumiiii. The liUovprctiiLlon iiii«l AppllcnLlon oC tlu; Intollitrencc 
(iiuaiunl. Journiil lOilucnlloiiul pHyclioloiry. .Iniuinry, 11)21. L. M, TtM’miiii. 
Moutiil (;ro\vLh IIII(I ICj, .ToiU-riul Etluciitiunul Psychology. October, 1021, 
rspcclnlly mi. :il)S-‘101. 

‘U'’i)r L‘\ami)lc, J. L. SlcnqulHt, Jtuiriml of Ediu'alloiuil nctioarcli, Dee., 1021. 

^For tlic N. I. T.p Ter mil II fl Viillejo iioniiH, inihllHli(‘(l In ll»c .1 4111 run I of 
/'Afueiiffonaf XlCHcnrcfi, Pchrmu-y, 1021, were UHCd. 
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the form, (1) the highest IQ in the class (2) the lowest, (3) the 
mefin and (4) the mean deviation from the mean. Column 7 gives 
the mean IQ for each subject; column 8 gives the mean deviation 
of the subject's various IQ's from his mean and column 9 gives the 
spread i. e., the subject's highest IQ minus liia lowest IQ. These 
data are summarized at the foot of each column. 

The facts of Table I may be considered with reference to certain 
important school problems. 

X, Is the class, on the whole, composed of bright or average 
pupils? A very general answer — bright — may be given, but 
the degree of brightness varies widely according to different 
tests. The mean IQ’s range from 109 (Dearborn Examination) to 
129 (Myers). According to the one the group should do slightly 
better than average work, according to the other, very much bet¬ 
ter. According to the one the average pupil could scarcely com¬ 
plete a coUege course, according to the other he could do so with 
ease. Assuming the average chronological age to be six years 
according to one test the mental age would be C,6 ye*^^s corre¬ 
sponding to first grade ability, but according to the other test the 
mental age would be 7.8 years corresponding to advanced Grade 
11 work. 

2. Are the pupils of uniform or diverse brightness? The 
figures for the lowest IQ nre fairly uniform, ranging from 92 to 
99 but those for the highest are diverse, ranging from 121 to 165, 
The mean deviation of IQ's from the average are for the Dearborn 
6.0 and for the Myers 12.3, with figures for the other tests scat¬ 
tering between these extremes. Recommendations concerning sec¬ 
tioning for purposes of promotion would depend very greatly on 
what test is used, 

3. What is the IQ of a particular pupil? Pupil A is given 
IQ’s ranging from 104 to 166, that is, by one test he would be 
classified as ''average" by another a "genius." Pupil A has 
various IQ's ranging from 104 to 144, Column 9 gives the differ¬ 
ence in points of IQ between the highest and lowest. The largest 
difference is 61, the smallest 16, the mean 32. On the average a 
pupil ranges from "average" to "very superior" intelligence de¬ 
pending on the test. If we take as measures of variability the 
mean deviation from the average IQ instead of the whole range 
bhe figures given in column 9 are of course smaller the greatest 
being 17.0 the smallest 3,8, the mean 9.3, That is if the average 
IQ is 118 in the average case half of the IQ's obtained from the 
several teats will fall between the limits 108.7 and 127.3. Further 
statistical treatment is unnecessary. It is obvious that the varia¬ 
bility of the IQ's obtained by several testa all given within n f ew 
days is so great as to make prediction concerning optimum rate 
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TABLE I 


showing I .Q.'a Obtained by Pupils op Grade I in Several Tests 



1 

2 

3 

4 

5 

6 

7 

8 
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0 

31 

WW 

U 

PPq 
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1 

a 

5 

U 

Wfi 

gs 

c 

d 

0) 

s 

^•5 

<0 
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A 

124. 

104 

135 

124 

126 

144 

120 

9.0 

40 

C 

120.6 

121 

144 

U4 

125 

131 

126 

7.7 

30 

D 

114* 

107 

122 

134 

102 

122 

117 

9.2 

32 

E 

135. 

IIB 

138 

126 

108 

121 

124 

9.2 

30 

F 

no. 

117 

no 

111 

112 

129 

116 

5.3 

19 

G 

133. 

112 

132 

116 

112 

126 

122 

8.3 

21 

H 

92.5 

99 

119 

106 

120 

116 

109 

9.5 

28 

I 

104. 

107 

140 

IIG 

111 

136 

119 

12.5 

3G 

J 

96. 

99 

117 

104 

107 

162 

113 

14.8 

56 

K 

103. 

92 

98 

98 

107 

99 

100 

3.8 

16 

L 

120. 

116 

131 

127 

114 

13G 

124 

7.5 

22 

M 

108. 

108 

125 

100 

99 

123 

111 

9.2 

26 

N 

no. 

lii 

135 

118 

125 

lU 

119 

7.5 

25 

0 

104. 

109 

139 

117 

lOG 

165 

123 

17.0 

G1 

P 

121. 

116 

137 

98 

117.G 

117.5 

118 

7.7 

39' 

Highestl35. 

121 

144 

134 

125 

1G5 

126 

17.0 

61 

Lowest 

; 92.5 

92 

98 

98 

99 

99 

100 

3.8 

15 

Mean 

113, 

109 

129 

114 

113 

129 

118 

9.2 

32 

M. D. 

10.1 

6.0 

7.6 

8*9 

.6-8 

12.3 

5.4 

2.2 

9.G 


SUMMAIIV 

OF IIFSULTS 

FOR miAim 

II n=lC. 


Higho'Stl41 

147 

148 

156 

160 

196 

160 

17,6 

7G 

Lowest 

; 103 

97 

122 

108 

92 

106 

114 

5.3 

21 

Mean 

117 

116 

132 

135 

124 

136 

127 

10.0 

35 

M. D. 

7.4 

7.3 

6.9 

12.4 

12.C 

IB.4 

7*6 

2*8 

10 
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of promotion, possibility of conipleting college, etc. quite out of 
the queation- 


RESULTS FOR GRADE II 

The results for Grade II are aummarizcd in the lowest section of 
Table I. For this grade, the group testa, nil of them non-verbal, 
are the same as those uaed in Grade I- 
The results are similar, The IQ*a yielded by the My era test 
show an average deviation from the meon which is more than 
twice that given by the Otis. One individual receives an IQ on one 
test which is 76 points higher than that given by another test; the 
difference between an average intelligence and idiocy. The 
average range of IQ for an individual is 36 points. 

RESULTS FOR GRADES III to VIII 

Table II gives summaries of the data for grades III to VIII. 
This Table shows the ridiculous results which teachers and other 
workers are likely to obtain from efforts to derive M. A.^a and 
IQ’s from group tests in these grades. For example, one fairly 
bright boy in Grade VII earns a mental age of 46 years on one 
test giving an IQ of 408, If they should take the results of 
certain tests seriously there are many pupils who could think 
rather pitifully of Sir Francis Gal ton whose IQ is estimated by 
Terman to be only about 200. According to the Myers test the 
average IQ’s of our Grades VII and VIII is 261.“ Picture the per¬ 
plexity of the teacher test enthusiast who finds that pupil K in 
Grade V earns an IQ of 99 on the National test and 366 on the 
Myers. Many others are nearly as baflling, 

The variability of scores obtained by a given individual be¬ 
comes greater as the grade becomes higher, ns may be seen in 
Table III which gives the range of IQ’s and M. D.’s for the aver¬ 
age individual in each grade. 

These facts should not be interpreted as n sweeping criticism 
of the usefulness and validity of group tests of general mental 
ability, What is urged is a restraint of certain inappropriate 
uses of these instruments. We should not, it is clear, compute 
M. A.’a and IQ's from raw scores, but these raw scores them¬ 
selves may be pub to profitable use. It has been shown elsewhere that 
these group tests at least those Very verbal in content give sub¬ 
stantial correlations with achievement in school work.” 

UCJ'h ctmld not be conipuLeil for Nntlonid iiml Otlfl peorea for most of 
our Grade VI I und Till oupUs because they carnc^d utorCH eouKlderably 
b I truer tlmii those repro«enLGtl Ijy tlie lino wlien IL Ijocomea horl'/oiUiil. 

“A. L. CorrclatIona of toftlH wUh uclilovciTiein In Kcbool 

aiibJcclH. Jo urn II I, of I'klucntlonnl l^sychology, Marcli, Aijrll niul May, 10122. 



UNRELIABILITY OF M. A. AND L Q. GROUP TE^STS 97 


TABLE II 


SIIOWINO HIGIIllST, LOWEST, MEAN AND M. D. OE I. Q.’S POll THE 
Oil AD E ACCORDING TO THE SEVEIIAL TESTS* IN LINES 
1 AND 'L DIFFERENT INDIVIDIIALH MA\- HE 
UEHIIKSENTEI) UY EACH FIGURE 


GRADE III 
2 3 4 6 


10 11 


fi 

M 


tzi' 


o 


C 'o 

11 *■ 


■§ B 

^ El 

"S ” ^ l-l 

a (j 

I ll 


!i1> Si- S.iJ 


Highest IQ. 133 127 133 13B 147 171 1G4 136 143 10.3 70 

Lowest IQ. 95 94 90 IOC 100 93 80 90 98 4.6 16 

Menn IQ.112 112 109 120 120 120 116 116 116 8.8 36 

M. D. from Mean 8.9 7.3 8.3 6,910.2 20.0 1B.3 16.2 8.7 2.2 11 


GltADB IV 

Highest . 140 133 142 399 166 176 162 174 164 Gl.O 292 

Lowest . 99 100 104 93 113 104 100 104 113 0.0 15 

Mean.120 113 124 168 135 128 126 136 132 17.2 73 

M. D. 7.1 6.1 5.6 61.4 12.4 11.0 lO.G 14.0 10.8 10.2 52 

ORADB V 

Highest .139 131 136 169 151 324 166 147 164 B6.4 266 

Lowest .100 100 98 IIB 113 81 109 112 110 6.1 28 

Mean .116 113 120 139 134 169 132 133 132 19.4 88 

M. D. 9.6 7.2 10.0 13.5 9.2 79 13.9 7.3 12,3.11.7 69 

GIlADia VI 

Highest .160 141 170 162 164 361 191 162 180 49.3 218 

Lowest . 83 88 80 92 95 70 • 92 97 90 4.8 14 

Mean .120 115 123 121 130 179 130 125 132 19.3 82 

M. D.18.8 12.9 20.2 15.9 16.6 76.6-20.6 13.0 21.8 11.9 65 

GflADI'] VII 

Highest .Not * 183 * 156 408 181,147 210 79.0 261 

Lowest .Given 109 110 74 94 104 103 7.3 26 

Mean . 137 132 261 138 127 169 43.9 146 

M. I). 14.2 18.0 96.217,3 0,219.6 24.4 77 

GRADE VIII 

Highest .Not 148 ’ 138 404 168 141 186 86.8 286 

Lowest . Given 105 91 88 85 96 172 5.8 20 

Mean . 124 116 261 124 111 147 46,9 167 

JVf.' D. 9.0 8.2 66.1 14.2 8.9 13.7 16.9 64 


*Scores for nearly all pupils above the equivalent of highest 
ages given. 
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TABLE III 

Ran[?e of IQ in the Mean Devintion from 
Several Tests for the Mean IQ for the Aver- 
Average Individiial age Individual 


Grade I . 32 0,2 

II . 35 10.0 

11! . 35 8.8 

IV . 73 17.2 

V . 88 10.4 

VI . 82 19.3 

VI . 146 43.9 


VIII . 167 46.9 

THE CAUSES OF THE UNRELIABILITY OF IQ’S BASED 
ON GROUP TESTS 

All effort has been made to ascertain the causes of iJie extreme 
variations in IQ given to the same individual by different tests 
nlthougli wo probably have been unable to discover tliem all or to 
evaluate accurately those that seem likely. 

First, the distribution of native mental ability in the groups 
upon which the tests were standardized has probably been un¬ 
equal. That this is often the case was clearly illustrated in con¬ 
structing norms for the National Intelligence tests,'' Such dif¬ 
ferences are not necessarily eliminated by mere accumulation of 
vast nmyibers of measures; a fact that is now quite genorally 
recognized. It is probably an important source of inequality of 
the test norms, 

Secondly, the character of school training, especially in read¬ 
ing, writing and arithmetic, affects the reaultn considerably. For 
example, if certain grades were backward in arithmetic in com¬ 
parison with pupils upon whom norms were established, they 
would obtain lower IQ's in those tests which contained relatively 
large amounts of arithmetical functions other things being equal. 

Again results will differ depending on the relative amounts of 
non-verbal material which the pavticulai’ tests contain. Two in¬ 
vestigations have shown that in Grades HI to VIII the correla¬ 
tions between verbal and non-verbal teats are low; sometimes 
negative in grade groups.^ In our results the association between 

^Soe L. Term nil nntl E. D. Whitmire. Ag'e nucl Grade norma Jor Lliu 
Nrllonnl IntclUuDiice TeBls. Jounin\ oJ Ediicatloiml lloaourcli. li'eljriinrr. 
1021,' and G, M, Whipple, National Intelllgonco Tebts. Journal oC 

Etlucfttlonal Itcacarch, June, 11)21. 

*J. P, Herring. Verbal Jirul nbHtract elomcntd la InLclllgoncc e.x;anilTm- 
tlona. Journal Edneatloiial Psychology. December, 1021, and A I, GiUch, 
same Journal, Wareh, April and May, 1022. 
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verbal and non-verbal teats becomes less close as the subjects 
become older, This fact is a partial explanation of the fact that 
the disagreement between IQ's is greater in the upper grades. 

The factor of greatest importance in our results is practice in 
group tests. Table 11 shows that Scarborough pupils earned IQ'a 
that are obviously too high. On the whole^ the more practice 
preceding a particular test, the higher the IQ^a obtained. There 
is.no doubt that practice results in very rapid improvement in 
such tests.® There are three ways in which practice will cause 
variations in IQ from teat to test: First, scores will advance con¬ 
siderably by virtue of general adaptation to test conditions; 
secondly, the gain will ha relatively great in the particular tests 
which contain large amounts of identical or equivalent exercises; 
thirdly, the norms for the tests will be high or low, depending on 
previous practice in intelligence tests as well as on general mental 
abilities of the subjects on whom the norms were based. Do 
those who construct norms for their tests actually ascertain the 
amount, if any, of previous experience in tests their subjects have 
had? Without a doubt norms established on uninitiated pupils 
will difFez* considerably, native ability being equal, fi-ozn those 
secured from pupils who have been tested extensively, 

Again, the ciimiilntivc procedure of, establishing norms prob¬ 
ably tends in the long run to produce norms that are too low. 
Testers probably succeed in controlling the time better than other 
conditions. In the long run numbers of students fail entirely to 
understand methods of procedure, skip pages, lose time through 
distraction, broken pencils, etc., etc., whereas the factors conspir¬ 
ing for higher scores arc fewer. Scarborough pupils were 
handled in small groups. They were provided with several 
pencils. They had learned to do their best in all ''tests." Dia- 
' tiirbances and misunderstandings very seldom occured. These 
factors would tend to produce differential success depending on 
whether a particular test contained more numerous speed or power 
exercises. Well practiced pupils would pi-obably have a con¬ 
siderable advantage over the inexperienced particularly in the 
former, because they make a quicker start and maintain a steadier 
performance. 

Finally, most of the Scarborough pupils are of superior in¬ 
telligence as evidenced by the Stanford-Binet IQ's (which aver¬ 
age about 117'“), by achievement in school subjects and by informa- 

“For oxainplQ, soe Knlglit DuiUni) nml Sj'ndur. Prrictlce ICffectH Jn 

IntelirgoiiCG TcfjlH, Journnl lilxporiiiiontiil PHycliolo^?y, 1020, p. ,1157-377, 

*®Tlil8 Htatomunt li3 made liccuuHC moHt o£ tlic Stdiiford tc-sts 'wore given 
before the experience In group tcBis nnd because, on retesting tlilif year, it 
is found that practice In group and other teats liaa not caused iiny marked 
Increase In IQ. 
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tion concerning the social status of parents. It is possible tbal 
very bright children -with a little practice may exceed avernge 
children in these testa by a larger amount than the IQ ratios 
would suggest. In support of thia view we find that some of the 
very bright pupils very greatly exceed tliQ norms for the grades 
to whicli their mental ages correspond in speed of reading. In 
depth or power of comprehension (Tliorndihc-McCall) however, 
their excess over the average, while marked, is not nearly so 
great, This would make for dilTerential success depending on the 
relative amount to which achievement in each of the several testn 
depends upon these abilitiee. 

It will not be profitable to Speculate further; wluit wc need is 
experimentation. These experiences have been sufficient to make 
one very cautious in the interpretation of group test scores and 
particularly cautious in the use of the M, A. or I. Q. 

The group tests arc chiefly uacful for purposes of rough 
classification and for very rough prediction but either should be 
undertaken only after inquiry into several factors, First, has this 
pupil ever taken such tests before^ If so, which, when, and how 
many? We need data badly to enable us to make a rough correc¬ 
tion in such circumstances. Secondly, what has been the subject's 
training in school subjects? It was found, for example, that some 
of our Grade III pupils made enormoug iniprovomcht in most 
verbal group tests as the result of having improved in reading 
during the interval between two testa. We need information con¬ 
cerning the transfer of improvement in all school subjects to 
ftchievemeut in group tests. Finally did the subject lose any time 
for any reason during the teat? This matter assumes great im¬ 
portance in some of the group tests. If all of the pupils have had 
no (or the same amount of) previoua practice in group intelli¬ 
gence tests if their school training has been the game and if no 
accidents occur the results, at least those of verbal tests, are 
very useful hut coarse instruments for classification. 

Perhaps a change from the terra ^‘intelligence tests^* to some 
such term a a ^^Glassification tests*' would have a favorable effect 
in reducing misunderstanding by teacher a and laymen and in 
curbing misuse by over-zealous testers: It has been well said 
that the work of measurement "may soon need protection from 
over-extravagant hopes more than from hostile criticism/""* 

“U. L. Thorurtlko- MoiiHTiromenfc In Kduention. The Tii^onty-flrnt Yoiir- 
book of the Nntlonnl Society Study o( hJdncfiLloii. Purt I, p. 8. 102C. 



NEWS AND COMMENT 


The Buretiu of Vocational Guidance of Harvard University has 
taken over the publication of the National Vocational Guidance 
Assoc j a lion Bulletin. It is theii’ purpose to enlarge and improve 
this Bulletin as support becomes assured for it. 

The Journal extends a cordial welcome to this new magazine in 
the field of vocational guidance. Professor Frederick J, Allen 
will serve as Editor. 


A NOTE ON POPULAR PSEUDO-PSYCHOLOGICAL 
BELIEFS 

ICornhauser and Jackson present data in a recent issue of this 
journal' showing that actual business men do not use quack systems 
of judging character in their employment work. The I'esuits ob¬ 
tained by the use of their questionnaire are rather surprising in 
view of the apparently successful exploitation of "applied psy¬ 
chology" by various charlatans who invade our larger cities, ad¬ 
vertise extensively in the newspapers and on the bill boards, give 
free lectures in the best hotels or theatres and then conduct large 
classes for four or six weeks at so much per head. Dr. Joseph 
Jastrow at Wisconsin has made a special study of these quacks 
and the writer believes as the result of conversations with Dr. 
Jastrow plus hi.s own observations in the quack-infected North¬ 
west that the merits of psychological research and applications 
are imperiled by this wide spread exploitation of pseudo¬ 
psychology, 

Pseudo-phycholog’icnl beliefs amounting: in some cases to super¬ 
stitions seem to be more common than most of us realize. The 
writer in conducting a summer school course in Applied Psy¬ 
chology was amazed to discover the range of interests expressed 
by these adult summer school students, but even more so, by the 
beliefs shown in answer to a questionnaire. TJie range of inter¬ 
ests included a desire to study the problem of learning, memory, 
how to study, business psychology, salesmanship, influencing 
people, personnel work, personality, vocational guidance, ab¬ 
normal psychology, psycho-analysis, spiritualism and character 
analysis. Below is given a summary of the beliefs expressed by 
these students at the beginning of the course in answer to a 
questionnaire. 

The above table speaks for itself. If mature summer school 
students exhibit such a variety of beliefs what must the average 
business man believe? It goes without saying that such a course 


note for the extent to wJHcli nyFitoms of character analysla arc uacil Jn 
the Dualncaa 'World,'’ Jour. Applied PHy., Vul. VI, No. S, Sept., 11)22, p. 3fl2. 
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SUMMARY OF DBUlill''S BIPUBSSED HY APPLIED PSYCHOLOGY 


STUDICNTS 




Positive 

Positive 

Unknown or 

Do you believe in; 

Belief 

Disbelief 

Uncertain 

1. Aetrology . 

. 2 

11 

7 

2. Chiropractic. 

. 10 

0 

1 

3. Fortune Telling. 

. 2 

18 

0 

4. Graphology. 

. 6 

fi 

10 

6. Hypnotism . 

..1. 12 

3 

0 

6. Memory Systems .... 

. 12 

7 

1 

7. Mental Telepathy .... 

1 III l| 1 lit 1 |i tlll'l 12 

8 

0 

8. Spiritualism... 


16 

0 

{). Palmistry . 

. 1 

18 

1 

10, Phrenology .. 

.. 6 

14 

1 

11. Physiognomy. 

.;. 11 

3 

6 

12, Psycho-therapy. 


1 

10 

13. Absent Treatment ,, 

.. 1 

12 

7 

14. Gifted Children are 

"Peculiar" 12 

8 

0 

15, Psychology Can 

Determine 



What Specific Job 

a Man Is 



Best Pitted for.... 


4 

0 

needa devote aomG time and attention to evaluating' the evidencfi 

for and against a large number of pseudo-psychologicnl systems 

following this up with a 

presentation of what applied psychology 

can do and can not do. 

Thug it turns out that phychological in- 

struction must serve as 

a sobering survey of the limitations of 

psychological appUcatioivs. It may be that business 

men are free 

•from such false beliefs yet the undersigned clasaifieg himself as a 

‘‘doubting Thomas." 




University of Minnesota 

Donald G, Patterson. 












BOOK REVIEWS 


Claparede, Edouard. Geneva, Switzcrla-ndf ProbloTns and 
Methods of Vocational G^iidance. International Labor Office, 1922. 
Price, 40 centa. 

Interest in vocational ^ guidance has been growing so rapidly 
that the International Labor Office has taken cognizance of it ns 
a subject of international importance. About two years ago the 
Office appomted the University of Qenevn ag its agent to collect 
information regarding the progress of the movement throughout 
the world, and to prepare news items for regular publication in the 
International Labor Review. This work has been carried on in 
increasing volume and with widening usefulness. In the meantime 
Professor Claparede hns been conceiving and directing investiga- 
tions fundamental to vocational guidance from his laboratory and 
from the Institute J. J. Rousseau, and he has brought out this 
brochure as a precipitation of the results of his study. 

IL is not a book. It is rather a survey that just escapes the 
severities of outline presentation. Furthermore it does not treat 
all phases of vocjxtionnl guidance. Though it recognizes the im¬ 
portance of the social, economic, physiological and educational 
aspect it treats specifically only the psychological, This it en¬ 
visages with great clearness. Particularly ssine and proportion¬ 
ate is the critical discussion of the difficulties involved in the 
application of tests in practical vocational situations, In his 
summarized conclusions Professor Claparede gives what miglit 
be regarded as an international message: 

"In conclusion it may be well to summarize very briefly the 
steps which should be taken to place vocational guidance on a 
firm foundation. 

1. Psychological analysis of occupations and their classification 
according to the abilities required. 

2. Determination of corresponding abilities in individuals and, 
as a preliminary^ the testing of tests to determine their diag¬ 
nostic, and even more their prognostic, value, 

3. Investigation of the .process of training and educability, 

4. Determination of the importance of general intelligence in 
the various occupations. 

d. It should never be forgotten that a forecast of ability will 
never be a certainty^ but only a probability. Statistics should be 
prepared to determine this probability. 

6. Efforts should be made to arrive at a uniform system of 
measurement so that psyohographs or psychological diagrams 
may be comparable between diffej:'ent countries and between dif- 
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ferent vocational guidance offices. GrmliiiK percentiles appears 
to be the most rational and least ambiguous nieLliod, 

It is in the social interests of the community that every man 
should be in the position for which he is bc>st fitted. IL ia also 
desirable and increasingly in accordance,with the spirit of modern 
democracy that the various social functions should be allotted ac¬ 
cording- to merit and not in virtue of any privilege. The only 
tneana of attaining this ideal is by n sound system of vocational 
guidance, All those who have at heart the harnionious orgiinizn- 
tion of society, both employers* and workers' organizations, should 
therefoi'G facilitate by all ineiina in their power any investigation 
having for its object the establishment of industrial p.sychology 
upon a firmer foundation.” 

Every* American phychologisfc who ia touching ever so lightly, 
either in his teaching or in hi a investigation, upon vocational prob¬ 
lems, should ponder on this brochure. lie will find posed for hi hi 
numerous problems for the experimental investigations so sorely 
needed, and he will find references to‘works of European investi¬ 
gators that are too little known in America. 

Indiana University H. D. Kitson. 

PnEScOTT) P, C, The Poetic Mind. New York: The Macmillan 
Company, 1922. Pp. 308, $2.00- 

There are two classes of people lo whom this book should be of 
special interest. The first are the psychologists. Ptofessor Pres¬ 
cott has for the object of his study the working of the poet^a min’d. 
His evidence is from the most reliable source—namely, from the 
poets themselves. An EiigUah professor, he has co Hoc Led from far 
and wide alatements of the poets nntl other creative artists con¬ 
cerning the source and manner of their inspiration; and with a 
surprising unanimity of opinion he has found that they Leatify to 
a power within from which their creative works emanate and over 
which they have no voluntary control, This mysterious source of 
power Professor Prescott attempts to identify with the subcon¬ 
scious mind, He seeks to show further, always depending for his 
chief evidence on the poets themselves, that the same principles 
which apply to dreams according to Freud apply also to poems, 
which are emanationa of the subconscioiis mind just as much as 
are nocturnal dreams. Poems, like dreams, have their origin in 
thwarted desires. Step by step Professor Prescott parallels the 
two kinds of dreams, showing that the impulse, the censorship, 
displaeementSj condensations, fusions, and fictional gratification 
are common to both and have the same explanations. Whatever 
be the merits of his findings, he has decidedly done the psycholog¬ 
ists a service by bringing them into contact with ii field of in vest i- 
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gation which few of them are likely to be so well qualihed as he 
to explore—the juental operations during* poetic inspiration as 
explained by the poets themselves. 

The book, however, should perhaps have even a fifreater appeal 
to the critic and the student of literature. In the first place, even 
if there is not a particle of truth in his thesis, it is a fascinating 
romance oC the subterranean caverns of the human mind, In the 
second place, if his thesis is i)artly true, his work becennes valua¬ 
ble and suggestivo. It sheds new lig'hfc on such ancient themes 
as the relation of beauty to truth, the calhursis of tragedy, the 
universality of the greatest poetry, symbols and figures, and even 
puns. In the third place, it is very possible that his thesis is true. 
Once grant the existence of a subconscious mind of the kind ac¬ 
cepted by many modern phychologists and the rest easily follows. 
The subconscious mind is old and wise, but not accessible to the 
average individual. The poet is one who for comparatively short 
intervals does have access bo it, though through no volition of hi a 
own. What have been regarded as his vague and misty dreams 
are in reality flashes of truth from a deeper mind, which is racial, 
universal, unhampered by the liinilation.s of time and apace and 
immediate needs. Poetry, therefore, represents the highest wis- 
dom of the race. Scientists plod along, and by the aid of the 
conscious mind finally confirm what the poet saw in his vision. 
Shelley, without the aid of modern psychology, states the idea ex¬ 
actly in his Defense of Poetry: “In the infancy of the world, 
neither poets themselves nor their auditors are fully aware, of the 
excellency of poetry: for it acts in a divine and unapprehended 
inanner, beyond and above consciousness, and it is reserved for 
future gQnerations to contemplate and measure the mighty cause 
and effect in all the strength and Splendour of their union.” 

It seems to me, however, that there is at least one rather serious 
inconsistency in the book. In Chaper VIII Professor Prescott is 
inclined to accept the conclusion of Wordsworth that emotions recol¬ 
lected in tranquility are “generally” the source of poetry. In 
Chapter XV he attempts to 'Show that poetry is the result of 
thwarted desires: that, as the poet may not have the object of hia 
desire, he seeks relief, even though it be a veiled relief, in n fic¬ 
tional gratification, as Keats, let us say, in The Eve of Saint Agnes. 
Such a relief is obviously needed and obviously would come when 
the emotion is powerful and not when it is recollected in tranT 
quility. Likewise in the last chapter Professor Prescott has no 
basis for even suggesting the possibility of poets for seeing spe¬ 
cific events in n literal sense, as Shelley foresaw his own death 
by drowning at sen. 

Ohio University. 


B. L. Jefferson, 
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TEt^RY^ Paul WasiIington* Hov) NuvieralB Are Read. Chicago, 
The University of Chicago, Supplomentnry Educational Mono¬ 
graphs, No. 18, 1D22. Pp. XIV+109. Price, ?1.00. 

Part I of Doctor Terry's excellent monograph deals with studies 
of the reading of numeral b by introspective methods. Part U 
contains an account of the usd of photographic apparatus in deal^ 
ing with this problem. 

It is the opinion of the reviewer that the chief value of the mono¬ 
graph lies in the suggested method of studying tho problem 
rather than in the reaulta of the experiment a, since a very limited 
number of subjecka participated. Part II, involving the use of 
photographic apparatus, containa the records of six subjects; in 
Part I, the number of subjects ranges in the various experiments 
from four to tein. 

In the first experiment, aeven arithmetic problems wete solved 
by ten graduate students who kept notes on their experiences while 
reading the problems '‘with special refer once to numeral s,'' These 
observations were organized and recorded in a' series of tables. 
The data made it possible to distinguish between a first reading 
and B re-reading in many instances as well as a partial and a 
whole first reading. 

Other experiments in which the method of introspective analysis 
was employed investigated the range of correct recall of numerals 
after the first reading, undertook an analysis of the re-reading of 
numerals in arithmetical problems and studied the success eg of 
four subjects in reading numerals in columns, 

- Important outcomes of the use of photographic apparatus are: 
*‘(a) The average number of digits included by n pause on nu¬ 
merals is decidedly smaller than the average number of letters 
jAtluded by a pause on words, (b) The average duration of 
pauses on numerals is greater than the average duration of pauses 
on words in the cases of all subjects, (c) The percentage of re¬ 
gressive pauses on numerals is greater than the percentage of such 
pauses on words," 

The final chapter of the monograph contains very pertinent sug¬ 
gestions for teaching children to read arithmetic problems, Inaa- 
much as the reading of numerals requires closer attention on the 
part of the reader than does the reading of words, it is suggested 
that during the first reading pupils be taught to devote their 
entire attention to the conditiohs of the problem, developing, at 
the same time, skill in the partial reading of the numerals. These 
conclusions are supported by the findings of .Gray and Preeman 
in the field of reading. 

Ohio University. r. L. Mojiton. 
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Knight, Frederick B. Qualities Related to Success in Teaching. 
Teachers College, Columbia University Contributions to Educa¬ 
tion, No. 120, New York City. Pp. x-|-67. 

When and why Is a teacher a. successful teacher? Many at¬ 
tempts have been made to nnawer this question in terms of such 
general categoriea as personality, poise, physical qualities, mental 
qualities, moral qualities, disciplinary skill, instructional skill, etc. 
The list can be extended and subdivided almost indefinitely from 
one of the several score cards for teachers now on the market. 
The objection that can be made to the above descriptive terms is 
their generality. Although they are more useful than a '^general 
impression’' as a guide to getting a useable criterion of teacher 
success, more exact and less subjective measures would be wel¬ 
comed by the school administrator. The study here under discus¬ 
sion represents a contribution to scientific education in that it gives 
results and particularly an improved method of attack on this 
problem. 

The first chapter summarizes the studies of Meriam, Elliott, 
and Boyce in this field. Chapters II, III, and IV nre concerned 
with the data of the author's investigation and the relative 
significance of the various traits and qualities studied. The last 
chapter gives a trenchant criticism of Boyce^s study. 

The general procedure of the first part of the investigation 
was as follows. Ratings ns to the relative teaching ability of 1B6 
grade and high school teacher's in three different school systems 
were obtained. That is to any, the best teacher was ranked first, 
the next beat second, etc., when compared with all the other 
teachers of a given system. Three such rankings on the general 
ability to teach were secured from the supervisors, the teachers 
themselves, and a selected group of pupils respectively. By the 
method of correlation the validity of these rankings, and their 
relation to age, amount of expei'ience, quality of handwriting, 
intelligence ns measured by test, major academic interests, normal 
school scholarship, amount of professional study during active 
service, and ability to pass a professional test Trade Test 
for Elementary School Teachers" by Knight and Franzen) was 
established. 

A few of the more significant conclusions may be given. 

"By using the coefficient of partial correlation we find, in the 
case of elementary school teachers, that, the factors of intelli¬ 
gence and normal school scholnrahip being constant, there is a 
mutual relationship of +.67 between ability to teach and ability 
to pass a professional test.... The amount of professional study 
accomplished during active service is also indicative of success in 
teaching. 
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"In the case of high school teachers, intollcetiiiil differences, ns 
maasured by mental testa, appear to be significant. For the 
selection of high school teachers the use of mental tests would he 
of value. 

^'These data, as a whole, may be interpreted to mean that the 
general factor of interest in one's work becomes the dominant 
factor in determining one's success in teaching....otlier mensur¬ 
able traits, cither alone ov in combinations, arc not ndequate ex¬ 
planations of teaching success. 

'"This study indicatea tlmb age, experience, quality of handwrit¬ 
ing, intelligence as measured by tests, normal school standing, or 
the expressed interests of teachers arc not closely related to suc¬ 
cess in teaching-" 

In the second part of the study intereovrelntions were found 
among the traits teaching ability, ability to understand and man¬ 
age people, intellectunl ability, ability to manage things and 
inechanisjns, general scholarship, skill in govcrnniciit or discipline, 
instructionat skill, initiative, nervous and physical strength, 
ability to command the respect of pupils and general ability to 
get results, the teachers rating each othor on these qualities 
after the connotations of these terms had been explained to iliein. 
Concerning these data the author concludes that the factor of gen¬ 
eral spread of estimate operates to invalidate such ratings. That 
is, "when a judge attempts to rate a teacher in some particular 
trait, his rating is a defense of his general estimate of that 
teacher, as well as a rating of the trqit under consideration." 

Doubtless the future will see a scientificaJly accurate and serv^ 
iceable measure of teaching ability. The rcsulta and methods of 
such studies ag this point the way to the solution of the problem. 

Colorado College Hermann Remmers. 

Wallin, J, E. W., The Ackievement of Suh?mrj/iai Children m 
StaTidardked Educational Tests, Miami University Bulletin, 
Series XX, No. 7. $0.60. 

In this bulletin of ninety-seven pages, Dr. Wallin gives the 
results of some educational tests ndininistered by special clas.^ 
teachers to about 300 Sfc. Louis subnormal children. The tests 
used were the Ayers spelling scale, lists A to F and I, L and O, 
and lists I and II in Starch's Spelling scale, Gray's oval reading 
and the spiral avithmetic excersises adapted from the Courtis tests. 

Bv, Wallin states that this "study should have n two-fold sig¬ 
nificance for educators interested in the study and training of 
feeble-minded and backward children: first, it ia the only siu'vey 
thus far made by several standardized educational tests of pupils 
enrolled in special schools for mental defectives; second, most 
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of the pupils tested had been psychologically examined and dif¬ 
ferentially diagnoaed, so that it ia possible to ftnaly2c the results 
from the educational teats with reference to the children's in- 
teliigcncc age, to their diagnostic classification, such as imbeciles, 
morons, borderline, bockward, visual aphasia cases, etc,, and to 
the grade assigned them by the special class teachers." 

The results of the cducitlionnl te.stfi show that it is a waste of 
time and money to attempt academic instruction to low •grade 
children below four years mentality and that little I’cnding can be 
accomplished by a child under the mental age of six years. On. 
the other hand the tests show that subnormal children who may 
develop to about the nine-year mental level should be taken care 
of in the public schools and that although their training should 
a reasonable amount of time should be devoted to academic 
be along the lines of the monumental arts and proper social habits, 
branches. Dr. Wallin is convinced that it is of extreme im¬ 
portance to take every precaution in placing children in schools 
and institutions for the mentally defective and that their educa¬ 
tional attainment ability must be considered as well as a mental 
diagnosis made, 

Ohio University. M. tiA ViNIA Warneo* 

Hiffk Schools mid Sex Education: A manual of suggestions on 
education as related to sex, Edited by Benjamin C. Gruenberg, 
Ph. D. Prepared under the direction of the Surgeon General, 
U- Sr Public Health Service, in co-operation with the U, S. 
Bureau of Education, Washington, D. G., Government Printing 
Office, 1922. Pp. 98. Price JPO.SO. 

This is a very helpful and practical book for teachers of nil 
young people of secondary school age. It makes clear the need 
of better methods of training in matters of sex. In the very 
earliest pages it differentiates sex education from sex informa¬ 
tion—a point which the lay mind seems to have been slow in 
appreciating. Sex information without interpretation of its mean¬ 
ing to society and the individual and without inspiration to use 
it for the uplift of the race falls far short of its proper place, in 
education. This little manual has been built up out of the accom- 
ulated experience of thousands of teachers who have attempted to 
handle the delicate subject of sex. It outlines the necessary prepa¬ 
ration of teachers of sex education, discusses the type of person¬ 
ality necessary to make such teaching valuable and presents prac¬ 
tical methods and devices by^which sex education may be accom¬ 
plished through the regular courses in biology, general science, 
physiology, physical education, home economics, and the social aci- 
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encea, Numeroua references arc cited in order that the reader may 
have an adequate background for more detailed reading. In the brief 
appendices at the end of the book are some very valuable sug¬ 
gestions on the use of special lectures, exhibits, courgea of study 
for teachers, personal hygiene and physical examinations. A very 
comprehensive bibliography of books dealing with sex and aex 
education ends the book. As a manual of what is being done and 
can be,done in sex education this book deserves a place in every 
teacher's library. 

Ohio University, G. H. Giiowdon. 

The World Book* Company, Yonkers, N. Y,, and 2123 Prairie 
Ave., Chicago, ill., announces the following': 

1. Otis ^elf-AdminiBtcj’inff Teats of Mental Ability^ a new 
aeries of tests for grades from four to twelve and for college 
freshmen, The Higher Examination is for grades nine to twelve 
and ceUege freshmen, the Intermediate for grades four to eight. 
Experimental try-oiita have been given in preliminary editions. 
Results have given high correlations Avith teachers' marks nnd 
estimates! Pour new advantages, it is argued, are to be had in 
these tests they are largely self-administering, very easily and 
quickly scored, afford a flexible time limit, and n wider variety of 
test material. There are two forms, A and B, each of equal 
difficulty. The Directions and Key with each package of 215, price 
$1.00 for Interinedinte, $1.10 for Higher Examination, 

2. Fillt7ier-Cu7imnf//lain Primary Afcntat Test: This is a new 
, group test for the kindergarten, firgfc ^nd second grades nnd the 

only one on the market suitable for kindergarten pupils. It has 
been tried out in several previous editions. The advantage of 
a test applies to the kindergarten and primary grades are that 
it enables the teacher to classify beginners (with no previous 
school record), and also to discover by comparison of results, the 
degree of everlapping in mental ages. 

The examination consists entirely of pictures. No reading or 
writing is necessary on the part of the pupils. The administering 
is sufficiently simple to require no special training on the part of 
the teacher. 

The examination booklets are sold in packages of twenty-five 
at $1:45 net per package'. The postpaid price of n Specimen Set 
is 20 cents. One Manual of Directions, one Class Record, one 
Report to Author and Percentile Graph arc included in each 
package! 

3. National Intelligence Tests, Supplement No. 2. The Com¬ 
mittee on National Intelligence Tests of the National Research 
Council has prepared Supplement No, 2 to the Manual of Direc- 
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tion 3 for the testis. This supplement contains revised ago normSp 
based upon the exAmination of 92,372 pupils in nineteen com¬ 
munities; composition of material for the age norms; data show¬ 
ing variability of the average mental ability of children from 
city to city; mental age equivalent of scores; revised grade norms, 
with tables showing composition of the -materials used^ and a 
formula for finding IQ's and table for converting years and 
months into monthsp 
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Ill pp. 
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FACIAL EXPRESSION IN ADVERTISEMENTS 


By Harold E. Burtt and J. Camden Clark 
Ohio SiaLo University 


INTRODUCTION 

The facial expression portrayed in nn advertising ent is fre¬ 
quently an important factor in the sale. Efforts to portray "satis¬ 
faction^* are quite common, and it is to this feeling that the present 
study is confined. 

Experiments upon the effectiveness of various types of adver¬ 
tising appeals have shown that this effectiveness varies with 
different commodities. This suggests that a similar relation may 
hold in the case of facial expression and that perhaps a satisfied 
expression in a cut may have quite different value in advertising 
difierent varieties of goods. It would seem, a priori, that certain 
purchases are serious and that pronounced satisfaction in the 
facial expression would be misplaced, while with other objects 
whose use normally provokes considerable satisfaction, such an 
expression would be desirable. It is .probable that the advertiser 
sometimes errs in the use of such facial expressions. One notes, 
for instance, cuts of a man laughirtg moderately at n game of 
solitaire or smoking a choice cigar with marked solemnity. Per¬ 
haps this is correct or perhaps it is irrelevant but at least it sug¬ 
gests a problem. 

The following study is devoted mainly to the problem of whether 
the optimal degree of satisfaction portrayed in the facial expression 
of an advertisement varies with the commodity advertised. A sub¬ 
sidiary problem is whether the apparent satisfaction in the facial 
expression of a photograph corresponds to the actual satisfaction 
felt by the subject who posed for it, i. e,, whether the picture act¬ 
ually conveys the feelings intended. 

It is impossible to approach such problems by strictly objective 
methods. The only possibility ia to obtain observers* judgments as 
to how they would react to certain pictures with reference to the 
purchase of various commodities. Judgments of this sort are per¬ 
haps difiicult and none too reliable but, with a sufficient number of 
observers and proper control of material and conditions, arc un¬ 
doubtedly more valuable than a priori generalization. 
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MATKUIAIi. 

Two sets of inaLiivial were used in Ihc experimeut. The fivst 
consisted of a series of bust photoKi’iipliH of the same male subject 
showing different facial ex pros sinus. Considerable preliminary 
work was necessary in securing a subject who could pose properly. 
The set finally used consisted of six photo graphs that were taken 
in succession, with the subject in the same position. The lighting, 
exposure and other technical aspects were constant. The subject 
posed in succession nix increasing degrees of sathsfaction stuiiing 
with slight and ending with rather exlrome, lie was conPiclont of 
the climactic elVoct and corvoborated this by ranking the pictuves 
subsequently, 

A set of these photographs wa.s enlarged to 7x9 inches and each 
one mounted without margin vrudev celhdoid for daylight display. 
Contact prints 4x5 inches were mounted individually on white 
cardboard of suitable aize for projection in a BalopLicon. 

The other material consisted of 211 cuts of men's faces taken 
from current advertisements and portraying various degrees of ap¬ 
parent satisfaction. Th was thought best to limit the faces to those 
of one sex thus avoiding an additional variable. The advertise¬ 
ments were trimmed so that none of the copy rein a i nod, and so that 
nothing in the cub suggested the Iciiul of commodity advertised. It 
was impossible to control siy.e but all the cuts were siifliciently large 
and sufficiently well printed to be scon without difTiculty when pro¬ 
jected on the screen. Preliminary experiments served ns a basis 
for selecting this final set of cuts from a somewhat larger number. 
The cuts were centered on white cardboard of suitable si 7 iG for 
projection, 

For presenting the enlarged photographs a display board was 
used. This consisted merely of a medium gray cardboard about 
2x3 feet mounted on a light framework with the longest dimension 
horizontal, There was a narrow gray rack at the bottom of the 
card and the top was tilted slightly away from the observer so that 
the photograph could rest against -the background- For the small 
photographs and the cuts a Balopticon was used to project them 
upon a screen, A metal plate actiinted by a spring held the card 
on which the picture was mounted in position and to change ma¬ 
terial it was necessary merely to depress the plate and insert 
another card. 

METHOD. 

Series 1 employed the enlarged photographs and the display 
board. The experiments were made in daylight with one observer 
at a time and all the results recoi'detl by the experimenter. This 
series comprised three parts, which were given in succession. 

In Series lA the photographs were presented one nt a time iu 
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xandom ordur (clifTereinb for each subject) with the instructions,. 
'^Describe lully the feeling's which this picture suggests to you." 
The complete introspection was recorded and subsequently an¬ 
alyzed, 

In Series ID the observer was given the six photographs in a 
pile ai'j^anged in random order and was told: "These pictures were 
taken when the subject felt different degrees o-f satisfaction. Ar- ■ 
range them in order with the one showing the most satisfaction on 
this ^end and the one showing the least satisfnotion on this cncl.^^' 
The observer's ranking was recorded in terms of the key letters on 
the backs of the photographs. 

In Series IC the photographs were again shown singly in ran¬ 
dom order with the instructions: "Name five commodities for 
which you think this picture would be effecLivo in an advertisement. 
For which of these live would it be most effective, next most effec¬ 
tive, etc,?" Tlie five commodities mentioned were recorded in order 
for each photograph. 

Series II practically repeated series I using the group method 
of experiincrifcatioii. The treatment of results was identical. The 
smaller photographs wore projected on the screen. The room was, 
of course, dai‘k bui could be illuminated sufficiently for writing by 
merely opening a door in the side of the Balopticon. The pictures 
were each given a key letter and presented in the same order in all 
three parts of the scries. This order began and ended with mod- 
rate degrees of salisfaction and no two adjacent degrees occurred 
in succession. 

In .Series JIA and Series IlC the instructions wore identical with 
those of IA and IC. A picture was prc.sented and its code letter 
given <verbally). After thirty seconds of darkness the room was 
illuminated for thirty seconds during which time the observers 
recorded their introspection on a blank; Another similar alterna¬ 
tion of darkness and illumination followed for the benefit of those 
who had not finished or who wished to note further aspects, A 
third alternation was given if requested by any observer. 

Series IIB involved ranking the photographs. Previous to the 
experiment the following six degrees of satisfaction had been 
written on the blackboard, but the observers’ attention not called 
to them until the proper time. 

1. Extremely satisfying. 

2. Very satisfying. 

3. Quite satisfying. 

4. Fairly satisfying. 

5. Slightly satisfying. 

6. Very slightly satisfying. 

The instructions were ns follows: "These pictures were taken 
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when the subject fell (UnFcrcut degeocH of ^utlsfuclioiu These dc- 
gvecs arc as fnUo\vs, (cxjiciinu*liter iioinls to llu» lifiL ou hoard). 
You arc to write down the six letters and the six numlmra with 
the proper letter. I will show the pictures in succosaiou several 
times so that you can decide carefully,” The iiliologrnplis were 
then shown repeatedly in the same oi'der and Die endo letter stated 
for each as it was shown, Kach prosenlation was of fifloon sec^ 
ouds duration followed hy a few seconds ilium illation. 

Seridf 111 employed the six small photographs and the twenty- 
three cuts in a group exporimciiL In the disen-ssion of results 
the former will be designated JllA and the liiUer nil). They wore 
glvcii^ however, at one sitting with the photograph.^ in n random 
order followed hy the cubs in a random order. These scries were 
concerned only with the problem of commodities and the jiulgmcnta 
were controlled rather than spontaneous. It had been found that 
pvacticaU^ all the commodities mentioned spontaneously in series 
1C and lie could be suinmarixcd umlev ten classes (cf. iiifni, table 
11). Accordingly, a mimeographed blank was provided with ruled 
columns headed with the names of these classes. Successive rows 
were likewise ruled and numbered at the left from i. to 29. The 
blanks were distributed and the following instructions givenr 
‘‘This is an experiment upon facial expressions in rehition to saV 
vertising. I am going to sliow you a series of pictures find in each 
case yon are to judge for whnt classes of commo(litic.s the picture 
would be elTective in an advertisement. By elYccUve is meant 
whether it would induce persons to buy the commodity in qiiestion. 
Coniine yoni' answers to the classes listed on the blanit. After the 
number of the picture put a 1 in the column to indicate the com¬ 
modity for which it would he most stfective and in the column ta 
indicate second choice. You may mark other choices if you wish 
but always give at least two-^' 

A picture was presented and its number given. After fifteen 
seconds the room was illuminated for ftftcen seconds, (an assist¬ 
ant operating the wall switch) for the observers to record Lhcir 
jiidgmojits. Another alternation of picture and illumiimtion fol¬ 
lowed. The experimenter then queried, ”All right?” and if there 
was no request for further repetition proceeded to the next pic¬ 
ture, There was no break between series IJIA and 

The ranking of satisfaction portrayed in the photographs was 
obtained from the subject who posed. As this was impossible with 
the cuts, fifteen observers who did not participate in scj’ics ///j 
ranked them. These observers were individually given the twenty- 
three card.s and told to arrange them with the one showing the 
most Satisfaction on the top of the pile and the one showing tliG 
least on the bottom and the intervening ones in order. The pile 
was returned to the experimenter who recorded ilic order. Then 
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the fifteen ranks given each picture were averaged. There \vas some 
disagreement among the judges in their rankings of the various 
cuts. Tlie mean variation of the fifteen ranks assigned to each 
picture was computed. The smallest of these mean variations is 
l.G, the largest G.7, and the average 4.2. If two pictures in this 
scries liad each this mean variation of 4.2, the probable error of 
dilTerence would be 1,3. So it would seem that a given picture was 
located nb least within a few places of its correct po.sitioin 

The subjects were .students—^mostly inulergraduates—in psychol¬ 
ogy classes at Ohio Stale University, Serhs / had 9 subjects, 
serre.H II, IG, and series III, G7. The group experiments were con¬ 
ducted by the senior writer, (Burbt).' 

RESULTS. 

The minor problem above mentioned will bo discussed first, viz., 
the cori'GspoiKlence of satisfaction actually felt with that apparent 
in the facial expression. Se?'?e.s lU and IIB give the most direct 
answer to this problem- For convenience in siibscciuont discussion 
tlie six photographs wdll be denoted by the letters U, V, W, X, Y, 
and Ti, wibli U the one in which the subject who posed felt the 
least satisfaction, V the next degree and so on up to Z the greatest 
sati-sfaction. The extent to which the observers' rankings of tlie 
six ijhotographs correspond to this order of satisfaction felt by the 
subject is shown in Table I. 

TABLE I. 


AVliUAOlO UA.NKS. 


Series 

U 

V 

W 

X 

Y 

Z 

IB 

5.8 

4.7 

4.4 

2.6 

2.2 

1.2 

IIB 

5.9 

4.9 

4.0 

2.4 

2.4 

1.3 

Both 

5.8 

4.8 

4.2 

2.5 

2..3 

1,3 


The original ranks were tabluated with the six made by a given 
observer in n row. Then the columns were averaged to obtain the 
average rank assigned each photograph. These averages appear 
in table I, for series IB, IIB and both together. 

It is obvious that the observers judged rjiiite accurately tlie 
satisfaction felt by the subject of the photographs.^ Considering 
the averages of both aeries the correlation is perfect. Moreover, 
the more detailed results show that all but three of the twenty-five 
subjects ranked. U lowest and all bub two ranked Z highest. The 
spontaneous descriptions of feelings suggested by the photographs 
indicate a rather climactic order from U to Z. 

This suggests LangfeldV finding,—covering a wide range of 
Jcjiirjiiil of A I) norm, Payeli, lOl.S, l.S, 1T± 

emotions and attitudes but not the one specifically studied in the 
present case,—of "uniformly good and con.'?istent'' judgments of 
emotions from facial expression. 

■Till* Avrllei-H IIro liulebtod Cor Hoiiiii snn:^^^‘^Tiola^ tUirliig l lio ('Birlli'r 
of I ho ivorlf fi) ]3r. Hurry W. Crniio. 

-Liingfelil, II, y.; Tho Judt/mcnl of J2niotionft from h'(i( lul 
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The mflin problem of the expeviment was the effectiveness of 
vai'ioua degrees of apparent satisfaction for (ulvertiaing various 
commodities. The results will be considered in terms of the 10 
classes of commodities under whicli pracLicully nil the spontaneous 
judgments fell. The results for .series /C and JIC were combined, 
as both used spoutaneovis reports an the same six photographs, A 
preliminary tabulation was made to show the number of times each 
commodity was mentioned in connection with cnch picture. Sepa¬ 
rate tables wore made for first clioicc.s, .Hccoiid clioiccs, etc., and 
totnl choices. Series IIIA which involved the same material with 
controlled judgments was tabulated in the same way. In aeries 
niB it did not seem worth while to cvtkliuite cnch picture sepa- 
rotely espocinllv in view of the rather conaidcrnhle dusagreement 
among the fifteen observers whose judgmonts provided the original 
ranhings for satisfaction. To facilitnto comparison with the other 
scries of six photographs the cuts were arbitrarily combined into 
six groups on the basis of the average .satisfaction rankings. Each 
group conipriscd 4 cuts witli the exception of the lowest satisfaction 
group which comprised 3 cuts. The division was made in this way 
to avoid drawing the line between cuts with the same average 
rank. A preliminary tabulation was made to show the number of 
times each commodity was mentioned in connection with each of 
these six groups of cots. Separate tables were made for first 
choices, second choices and totnl choices. 

The results could now be considered from two standpoints. On 
the one hand It was possible to determine for unch commodity what 
proportion of the mentions were accorded to ench picture or group 
of pictures, i, e., what degree of satisfaction was most frequently 
selected as appropriate for a given commodity. On the other hand, 
it was possible to note for each picture or group of pictures what 
proportion of the mentions were accorded to each commodity, i. e., 
what commodities were most frequently selected ns ones for which 
a given degree of satisfaction would be appropriate. 

Table II presents the results from the former of the above gtand- 
points. 
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TABLE IL 

miOTxNTACK DLSTIDBUTlCiiN OF TOTAL CHOICES FOIl T3ACII 
COMMODITY. 


Commodity 

Series 

n 

IT 

V 

w 

X 

Y 

Z 

Amusements'—indooi' 

IC-HIIC 

33 

3 

3 

12 

21 

27 

33 


III A 

87 

1 

25 

22 

23 

14 

16 


III B 

287 

3 

12 

31 

16 

22 

17 


Av, 


2 

13 

22 

20 

21 

22 

Amu sement s—outdoor 

IC+IIC 

14 

0 

14 

7 

29 

21 

29 


in A 

98 

0 

13 

12 

32 

26 

17 


in B 

313 

1 

11 

19 

30 

27 

12 


Av. 


0 

13 

13 

30 

25 

19 

Automobiles 

IC-I-IIC 

15 

20 

27 

2D 

20 

7 

7 


in A 

55 

4 

13 

15 

20 

33 

16 


in B 

276 

a 

7 

29 

23 

7 

26 


Av. 


11 

16 

21 

21 

16 

16 

Clothing 

IG-hllC 

94 

24 

14 

18 

15 

18 

11 


III A 

106 

51 

18 

13 

4 

5 

9 


III B 

425 

32 

16 

Id 

21 

3 

10 


Av. 


3G 

16 

16 

13 

9 

10 

Food 

IC-hllG 

37 

0 

0 

16 

27 

32 

24 


III A 

70 

0 

11 

21 

16 

26 

26 


III B 

253 

3 

23 

14 

12 

29 

Ifi 


Av, 


1 

11 

17 

18 

29 

23 

Photographs 

ic+nc 

18 

44 

11 

22 

22 

0 

0 


in A 

127 

51 

15 

9 

7 

9 

8 


III B 

205 

31 

22 

11 

11 

10 

14 


Av. 


42 

16 

14 

13 

6 

7 

Publications 

rc+iiG 

19 

21 

0 

6 

26 

11 

37 


III A 

33 

3 

9 

30 . 

.12 

12 

33 


III B 

254 

15 

28 

13 

6 

13 

25 


Av. 


13 

12 

16 

15 

12 

32 

Schools 

IC-hllC 

22 

65 

14 

18 

0 

9 

5 


in A 

23 

26 

4 

26 

4 

22 

IT 


III B 

230 

13 

46 

7 

10 

13 

10 


Av, 


31 

21 

17 

5 

15 

11 

Smoking supplies 

IC+IIG 

48 

4 

12 

17 

25 

19 

23 


in A 

84 

4 

30 

15 

21 

17 

13 


III B 

312 

6 

12 

9 

16 

16 

42 


Av. 


6 

18 

14 

21 

17 

26 

Toilet articles 

IC-!-IIC 

92 

4 

7 

11 

33 

20 

26 


in A 

67 

2 

13 

10 

25 

18 

31 


HI B 

352 

15 

10 

23 

14 

29 

9 


Av. 


7 

10 

15 

24 

22 

22 
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ing supplies Toilet articles ' _ y\vera^ 
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The original figures were reduced to per cents to make the vari¬ 
ous aeries comparable. Only "total choices" are considered. First 
choices were tabulated separately but did not differ substantially 
from total choices nnd the latter were then selected because they 
involved a larger number of cases. The first column gives the 
classes of commodities, the second the series and the third the 
number of choico.s or mentions involved. The following six figures 
in a given row indicate the per cent of mentions for each of the 
six pictures or group of pictures. The headings U, V, W, etc., 
indicate increasing degrees of apparent satisfaction from U to Z; 
for series 1C, IIC and IIIA they denote the six photographs, and for 
IIIB they denote groups of four cuts except that U involves only 
three cuts. For example, of the thirty-three times indoor amuse¬ 
ments were mentioned in serie.? IC and llC, throe per cent of these 
mentions were for photograph U, three per cent for V, twelve 
per cent for W, etc; while of the 287 mentions of indoor amuse¬ 
ments in series IllB, three per cent were for twelve per cent for 
V, thirty-one per cent for \V, etc. Moreover, the average of the 
throe series as far as indoor amusements arc concerned gives two 
per cent for U, thirteen per cent for V, etc. 

These same results are shown gi’aphically in Figure 1. 

The ten sets of curves corro.spond to the ten blocks in Table II, 
In each set the different lines denote the three series and the aver¬ 
age of the three as shown in the key. The abaeissae of the curves 
denote from left to right the six classes If, V, W, X, Y, Z, while 
the ordinates repi'e.scnt per cents. The totol of the ordinates of 
each curve is, of course, lOO per cent. It should be noted in the 
figure and the table that the value for U in series IIIB should be 
perhaps n triHe larger us it involves three pictures instead of four. 

The results arc considered from the other aforementioned stand¬ 
point in Table III. 
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TABLE III. 

PBUCENTAGE DlBTlllBUTlON OF TOTAL CHOICES FOR EACH 

PICTURE. 


o a 

(u a, 


m 

-S 

"m 

HI 

0 

Cl 

H® 

<h 

OlI O 

Oi o 
P'd 

c 

E 

c 

5 

c 

'3 

O 

o 

• u 

OJA 

Cl 

u 

Qj 

O 

'Ji 

js a 
c o 

Oi 

0 

c» 

id 

V 

gS 

c s 

<» 

W 

<1.9 

<J o 

<j!a 

O 


^ bll 


W 


H bs 

ic+nc 

2 

0 

5 

40 

0 

14 

7 

21 

4 

7 

HI A 

1 

0 

1 

41 

0 

49 

1 

4 

2 

1 

HI B 

2 

1 

6 

35 

2 

17 

10 

a 

5 

14 

Av. 

2 

0 

4 

39 

1 

27 

6 

11 

4 

7 

rc+iic 

3 

6 

11 

35 

0 

5 

0 

8 

16 

16 

in A 

17 

10 

6 

15 

6 

15 

2 

1 

20 

7 

in D 

7 

7 

4 

14 

11 

0 

14 

21 

7 

7 

Av, 

9 

7 

7 

21 

C 

10 

B 

10 

14 

10 

IC+IIC 

7 

2 

6 

29 

10 

7 

2 

7 

14 

17 

III A 

16 

10 

7 

12 

13 

10 

9 

6 

11 

6 

III B 

17 

11 

IB 

15 

7 

4 

6 

3 

B 

16 

Av. 

13 

8 

9 

19 

10 

7 

6 

5 

10 

13 

IC+IIC 

a 

B 

3 

16 

11 

B 

6 

0 

13 

34 

III A 

16 

25 

9 

3 

9 

7 

3 

1 

14 

13 

III B 

10 

10 

13 

18 

6 

5 

3 

6 

11 

10 

Av. 

11 

16 

8 

12 

9 

G 

4 

2 

13 

19 

IC+IIC 

12 

4 

1 

23 

16 

0 

3 

3 

12 

25 

III A 

10 

20 

14 

4 

14 

10 

3 

4 

11 

10 

III B 

13 

17 

4 

3 

15 

4 

7 

G 

10 

21 

Av. 

12 

14 

6 

10 

16 

6 

4 

4 

11 

19 

IC+IIC 

14 

5 

1 

13 

12 

0 

9 

1 

14 

31 

HI A 

10 

14 

7 

8 

16 

8 

9 

3 

9 

17 

III B 

9 

7 

14 

8 

9 

B 

12 

4 

26 

6 

Av. 

11 

9 

7 

10 

12 

4 

10 

3 

16 

18 



FACIAL EXPRESSION IN ADVERTISEMENTS 124 


The first column gives the picture or group of pictures and the 
next tlie series. The following columns in any row indicate the 
pBr cent of mentions for each of the ten commodities- For in¬ 
stance, with picture U in senes IC and IIC, 2 per cent of the 
observers selected indoor amnscmenta na a commodity for which 
U would be suitable, C per cent selected automobiles, 40 per cent 
clothing, etc. 

Series IC and 7/C involved about fifty total menLions, series 
HI A about 130 and ////? about bOO, for each photograph or cut. 
Figure 1 and Table III show fairly consistent results with certain 
commodities but nob with others. 

The curves foi' indoor amusements agree in starting low and 
they approach each other closely again at X. In Table III this 
commodity is seldom mentioned for U but more frequently thero* 
Rfter. Apparently slight satisfaction is undesirable while it is 
nob clear whether moderate or greater degrees are most desirable, 

With outdoor amusements the case is clear. The curves show 
marked agreement with a minimum at U and a maximum at X. 
In the table for X, onLdoor anmseineiita stand next to the highest 
in average mentions. Evidently a rather marked but not extreme 
degree of satisfaction is the most desirable. 

It is impossible to draw any conclusion regarding automobiles 
because there is little agreement among the curves and the average 
curve is nearly level. 

The curves for clothing all start high and descend first abruptly 
and then gradually, while in the table, picture U has a large pro¬ 
portion of mentions as suitable for clothing. Evidently, the slight¬ 
est degrees of satisfaction used in the experiment were the most 
suitable for this commodity. 

Food shows a fair agreement in the curves, with a gradual rise 
toward the higher degrees of satisfaction. This relation is not as 
clearly manifest in the table, but on the whole it seems that n 
fairly high degree of satisfaction should be effective in food adver- 
tisements- 

The curves for photographs are rather similar to those for 
clothing and the tabular results also arc similar. Apparently, the 
slight degrees of satisfaction should be most effective, 

The curves for publications are equivocal with a suggestion of 
a uniform rise at the end. This fact is not clearly borne out by 
the table. 

There is considerable discrepancy at the left in the curves for 
schools although the average trend is downward. The table is 
inconclusive, If there is any sue'geatioTi it is toward the effective¬ 
ness of the lesser degrees of satisfaction. 

Smoking supplies show a fairly consistent and gradual rise in 
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the curves. The table indicates frequent mention of this com¬ 
modity, for all the pictures except U- It would seem that any but 
the slight degrees of satisfaction would be desirable and perhaps' 
there would be a slight gain in effectiveness as the satisfactioiL 
was increased. 

Toilet articles have a fairly conaiatent rise through the lessei’- 
degrees of satisfaction with little average change thereafter. In 
the table toilet articles are frequently mentioned for all pictures 
except the first. It seems that an average or greater degree of 
satisfaction should be effective in advertising such articles. 

The above results depend of course upon the judgments of an 
untrained, unselected group of students. They may have judged 
in some instances by factors other than the one studied. Recogni¬ 
tion of a picture, for instance, might sometimes a fleet the results, 
the conclusion that for clothing and photographs, advertisements 
showing rather slight amounts of satisfaction should be more effec¬ 
tive than those showing greater amounts, while for outdoor ainiise- 
ments, food, smoking supplies and toilet articles tho moderate or 
high degrees of satisfaction should prove more effective. In the 
case of outdoor amusements and food there is a further suggestion 
that the satisfaction, if carried to the extreme, may lose somewhat 
in effectiveness. 

A further interesting problem would be to determine whether 
current advertising seemed to follow the above principles oi* to 
run counter to any of them. This would necessitate the collection 
of a large number of advertising cuts and their ranking by a 
group of observers. A little evidence may be obtained by consid¬ 
ering the twenty-three cuts used in the present experiment in the- 
light of the commodities they had been originally insed to advertise, 
Tabic IV shows how the commodities originally advertised by the 


TABLE IV. 
U V 


Indoor oniusenienfcs 
Outdoor amusements 
Clothing 
Food 

Smokers’ supplies 
Toilet articles 


W X Y Z 
1 1 

1 1 

2 1 

2 13 12 

1 

12 2 


cuts used are distributed thvoug'h the six degrees or groups of sat¬ 
isfaction. There were, of course, too few cuts for a given com¬ 
modity to permit much generalization, but clothing, for instance, 
occurs only in classes U and V which was shown above to be a 
desirable situation. Outdoor amusements avoid U and V as they 
ought to. Food, smoking supplies and toilet articles for the most 
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pai't occur in fchc hie-Hcr fleg^roes but have some instances in U and 
V which according to the above findings is undesirable. Without 
more data on this point it would be rash to criticize advertising 
policies but the method just described if applied on n large scale 
would doubtless be illuminating. 

The results of the main portion of the experiment are, of course, 
applicable only to the extent that the facial expression of a cut is 
a selling point in itself, i. e., the apparent satisfaction of the user 
is* supposed to be an Inducement to the reader to buy. There nre 
many occasions when there is some other leading selling point and 
the facial expression is one designed to emphasize it. In such a 
case, the foregoing results would be irrelevant* At any rate it 
seems clear that the advertiser should not always strive to portray 
a maximum satisfaction in facial expi*essions but that the optimal 
degree varies with different commodities. 

SUMMARY. 

The foregoing experiment employed photographs posed by a sub¬ 
ject feeling different degrees of satisfaction, and cuts from current 
advertisements portraying apparently various degrees of satisfac¬ 
tion. Individual and group methods were used. The observers 
stated the feeling,'? suggested by the pictures, ranked them for ap- 
p^irent satisfaction and gave the coin modi ties for which they 
thought each picture would be most effective in an advertisement. 
The results were tubulated to show the correspondence between 
flctLinl satisfaction felt by the subject posing for the photographs 
and apparent satisfaction judged by the observer. The correla¬ 
tion proved to be very high. 

The results were also troated in various ways to determine the 
optimal degree of apparent satisfaction for advertising different 
commodities. As far ns the results go, the lesser degrees of satis¬ 
faction apj^ear more suitable for advertising clothing and photo¬ 
graphs, while the moderate or high degrees are better for amuae- 
rnents, food, smokers supplies and toilet articles. 

The results are, of course, irrelevant when the facial expression 
of satisfaction is not itself a selling point, but in casQs where it is 
a selling point the conclusion may be drawn that it is undesirable 
to always strive for the utmost satisfaction but that the optimal 
amount depends on the kind of commodity advertised. 



COMPAEATIVE SOCIAL TRAITS OP VARIOUS 
RACES, SECOND STUDV 

By C. B. Davenport and Laura C. CnAYTon. 

In "School nnd Society'' for October 22, 1921, one of us published 
a study of "Comparative Social Traits of Various Races." This 
study was based on only B1 individuals and was confessedly frag¬ 
mentary. Ib was published in the hope that it would stimulate 
others to make similar sbudics. How far this hope has been real¬ 
ized we can not any, but at least the first paper doubtless made it 
easier to secure -cooperation of other teachers in collecting such 
data. The present study is due to the interest taken by Dr. R, S. 
Benedict of the Stayvesanl High School, who undertook to secure 
additional data from his pupils and to whom we are greatly in¬ 
debted. These have doubled our totals. Since the latter are exclu¬ 
sively for boys, while the earlier were exclusively for girls it has 
seemed useful to combine the two collections to get results that 
may be expected to hold for the population as a whole. A compari¬ 
son of the sexes is hardly possible with the small numbers available. 

As stated in the earlier paper the purpose of the stiply is to 
replace opinion as to race (liiTerencc.s in social traits by quantita¬ 
tive estimates* 

The method is exactly the same in the two studies. The in de¬ 
pendent judgments of one to three toachers were obtained con¬ 
cerning ten traits of each pupil, iiainp; the graphic rating scale of 
the Scott Company, Philadelphia ("School and Society" XIV, p. 
346). The data were tabulated and appraised as stated in the 
earlier paper. Probable errors have been calculated in order that 
the significance of the dift'crencea may be made clearer.^ The re¬ 
sults are tentative. It is hoped that this paper may stimulate to 
further studies of this subject, 

RESULTS. 

Altogether 188 sets of judgments were rciidGrod on 102 persons, 
ns follows: 20 on 10 Germans; 15 on 9 Irish; 37 on 22 Italians; 
59 on 31 Austrians, and 67 on 30 Russians, also 11G on G1 Jews, 
being the sum of the Austrians and Russians, just listed. 

There were calculated for each of thc.se nationalities the mean 
of the judgments for each trait and the probable error of the 
mean. These means and probable errors are given in Table L 
Thus under Germany, Leadership, we find the mean of the 20 
estimates made on 10 persons to be 59.7^3.0. This means that the 
position of students of German stock, in respect to leadership, was 
on the average slightly above mediocrity, or 50%, There is, how¬ 
ever, an even chance that the true value (theoretically based on an 
infinite number) is only equally apt to occur within the range 
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B6.7-62i 7 fts oiitsido thot rani?c. It is usually held that differ¬ 
ences between two means whicli arc greater than three times the 
squnve root of the sum of the prohable errors of the moans is cer¬ 
tainly n sigidficant difference; that it depends not merely upon 
s/yi.'di numbers, but upon a veal difference in the "set'* of those 
numbers. For uxnniplo, while the mean of 20 cstimatos concern¬ 
ing leadership of .sUideiiLs from Germany is 50,7^3.0, that of 16 
estimates of sliulenis horn in Ireland is 38.3±5.0. There is> thus, 
n (lidevcncc of 21.5 in the mean of iho judgments for the two 
countries. The Rquare root of the sum of the squares of the prob¬ 
able errors is 5.8, Three times 5.8 is 17.4 which is less than the 
ciifFereiicG of the means; hence the difference between the means is 
probably a biologically significant one. Even with the probable 
errors the "conclusions" must be held to be merely tentative; for 
the "probable error" lias not the significance with small numbers, 
that it has with large numbers. 
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In Table I the means and probable errors are given for five 
nationalities, namely, pu]>ils who came, or whose ancestors came, 
from Germany, Irelnml, Italy, Austria and Russia. The students 
of Austrian and Russian stock in this New York City school are 
almost exclusively Jews. It seomod worth while to combine those 
from Austria and Russia under the heading of "Jews”, and these 
results are given in column 0. Table I then should give us some 
Aort of an answer, Lliough imperfect, lo the inquiry with which 
we started na to the dilTerence in social traits of persona of differ¬ 
ent nationalities. 

CONCLUSIONS. 

While numbers arc still insnnicicnt to form final conclusions, the 
results suggest the following tentative conclusions. 

In leadership the German children stand first at B9,7^3.0 points 
quite markedly above the others. The difference between this men 
and that of the Jews is les.s than three times the probable erroi 
Movertheless the Jews may be considered as a race charncterixe 
by a medium leadership. On the other linud, tlie Irish and Italian 
are characterized by a low standard in leadership, nnd the dif¬ 
ference botwoen them and the middle group is, doubtleas, signifi¬ 
cant. 

In pertbiaciip the Germans stand first. This group is probably 
higher in respect to pertinacity than the Jews. The Irish and 
Italians stand lowest in Lhi.s respect. 

In humaVj the Gerinnn children stand first (G2) and the Irish 
stand second. However, the difference between these two nation¬ 
alities is not great and, indeed, not to bo differentiated from the 
Austrians and the Jews in general. Between this group and the 
Italians there is probably a real difference in respect to national 
humor, 

In franhneaa the German children again stand first (67) and the 
Jews, and especially the Austrians, arc a close second. The Irish 
and Italians fell into a slightly lower clas.s. 

In siispicioiLH'iiesiij Jews and Irish stand above the others. Prob¬ 
ably the Italians arc not significantly lower. The Germans, how¬ 
ever, ai’Q probably least in this respect and certainly are quite 
distinct from the Jews. 

In synipathp the Germans stand highest, the Jews and Italians 
may be included in the medium category. The Irish are least in 
this respect. 

In loyalipf the Gei'inana stand highest, but in the same category 
are also the Italifina and Irish. The Jews occupy a lower position. 

In (/enerosity the Germans, Italians, Irish and Jews stand at 
nearly the same level. 

In 91 vesicas the 61 Jews stand at the lop (B2) and seem to 
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ioYTii a class distinct from U\c Germans, Irish imd Italians which 
form a middle or lower group. 

In coolness the Germans and Irish sbnnd easily Tirsb (8G). In n 
signiftcnntly lower group stand Lhc Italians and Jews. 

The 10 Germans stand at, or near the top in Leadership, Perti¬ 
nacity, Humor, Prankiiesa, Sympathy, and LoynUy, more than half 
the traits. They occupy a relatively low position in Siispicioiisness. 

The 0 Irish fall in the upper group in respect to Humor, Siiapi- 
ciousnesa, Loyalty and Generosity, imtl in the lowest group in re¬ 
spect to Leadership, Pertinacity, Frankness and Sympathy. 

The 22 Italians stand in the upper group in regard to Loyalty 
and Generosity and lowest in rcgftvd to Leadership and Humor, 

The 61 Jewish children stand in the first group in Humor, Suspi¬ 
ciousness, Generosity, and Obtrusive ness and in the medium group 
for the other traits. 

In addition to the mean values of the social traits for the clifrer- 
ent nationalities, there is a difl-erence in the variability of jiulg- 
ments of persons from different conn tries, and it has seemed worth 
while to consider this variation. Accordingly, the standard devia¬ 
tions of the judgments for each nationality and trait arc given in 
Table III. The probable errors have also been calculated us a 
means of judgment of signifiennee, or rnlhor, lack of significanco 
of the difference of these indices of variability. Thus, from Table 
III, it appears that the variability in the judgments on Leadership 
is greatest for the Jews the standard devialioii being 28.1 ±1.3. It 
is least for the Germans, 20.0±2.1, Allhongli the difference may 
not be a signiffcant one, there is a suggestion that the Jews (iivS 
represented in our statistics) include strains that vary more from 
each other in Leadership than in the ease of the Germans. 

On the other hand in Pertinacity, the Italians showed themselves 
the most variable and the Irish the least, although the difference, 
even in this ease, is leas than three times the probable error. 
Again in Humor the variability in judgments rendered on Italians, 
Jews and Irish are high, and for Germans somewhat lower. One 
of the stvUdng differences in Table III is the slight variability of 
the Germans in regard to Coolness (15,2), a trait in which they 
stand at the top, and the variability of the Jews in this trait 

(22.8) , a trait in which they stand at the bottom. Taking the 
average of the standard deviations of the ten traits for each of 
the nationalities, we find that the variation is greatest in the Jews, 

(21.8) and next in order in the Italians and Irish and least in the 
Germans. 

Prom another standpoint it is interesting to compare the varia¬ 
bility of the different traits for all nationalities. This average has 
been entered in the right hand column of Table III, The order of 
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the Average vnriution for these ten traits is as follows: Leader" 
sliip-26.5| Iliunor—25.(1, Pertinacity—23.2, Frankness—21,6^ 
Cooliiefl.s-20.7, Ol)tru.sivciie.ss-20.il, Symp.'ithy-18.2, Suspicions-- 
iicss-17.7» Genero.sity—1(),2, Loyally—14.2. 

The iiitcrpretiitinn of the ililtercnces in averages of the ten' 
traits is not easy, It may indicate a dilferoiice in the intrinsic 
voriubilly of the ti’ails or a dilTercnee in the case or certainty of 
estimating Lhoin. One secs no inliereut I’cn.son why it should bii 
easier for teachers to estimate Loyalty of pupils than to estimate 
capacity for Lciidel',ship. It .seem.s to me more probable that Loy¬ 
alty is a trail in which sludonla (in their leaehers’ opinions) stand 
nnifornily riilhcr high, and that Leadership is a (lualily in which 
they show great (liver.sity. 

ipi'. l Artliiir Hiirrls ('iiIIn my flllcndoii lo (lie fact tliiil llic tirolwlilc 
mdi'sniiO Ilia Nliiiidiivd dcvliulons iiikiu wlilrli llicy lire hnscil are itroliably 
liilliii'iiccil, m .wiiir i‘.\n'iil, liy llic I'lirl Unit ilijrrri'iit ii.'iiclierfi riiicil tlio 
(llflmnl Intllvldiiiilai mid one set of ((‘HcIici'S nili'd ii Ini'Kor iiropurtlon of 
llic tii'i'inim slmlciilH lliiiii nnoHiiT scl whlcli tri'iili'd, any, ii Inruiu' propov- 
lion (if the li'lsli. 'I’liiiH luiy illfti'VMici' In (lie iii'raiiinil cqnnlloii of llicso 
iivo grinipH (if I'lilni'H wmild ho I'l'llrclcd lij llir iiiiiifnlludo of llic varliibil- 
lllos. Ilciu'wn 111 lives of (lie ilKl’eivnt niceH were, «f etiiirKO, tllRirllmicd 
nnionp Ihe teaelievH wlllimit any eiiiiscldiiH .soledIon, SMll 11 la tnu; Hint 
ftic inffereiit mill'd i-.'KeM did not rule mi e(|iii(l rii'iiiioi'lloii flf peesons of 
Ilia diaetenl iiiill(iniimien; In iitlier woi'ild, llie (lin'ereiif wela of rulers did 
nut iihty nil i‘(|iiiil purl In (leliTiitlJlIiiff Hie iivempo raj])))' of persons bo- 
lonslnu' In dlfl'ereiit iiiillimiilllles, TIiIh Inli-ndiu'CS n [iii'llier eri'itr wbich 
wnulil only lie overcoiiK; when liii'Ker iiiunliers of slmleiita lire riited, 
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A CONTRIBUTION TO THE TECHNIQUE OP 
PARTIAL CORRELATION 


By C. Ij. IIuffakp.u 
State University of Iowa 

It is well recognized fehnt the partial regresaion cquatioii is the 
best tool for the study of mxiiiy odiicttUonnl probloniH. This is 
particularly true if the problem involves (1) the analysis of n 
^'general ability'* into its component specific abilities, or (2) the 
determinotion of the diagnostic value of difreront tests. In the 
schema developed by the computation becomes very compli¬ 

cated and laborious if the number of varinble.s is nt all numerous, 
Methods of shortening the labor have been devised by Kelley^ and 
RosenoV. The schema devised by Roscnow rccinirca only about 
half the labor of that of ICelley, but it has the very important 
shortcoming' that the signs of nil but two of the liighest order 
coefHcients are indeterminate. It necessarily follows that the 
signs of all the regression coefficients arc indetcrminnLe except 
two. This shortcoming imposes a serious liniitnLion on the use¬ 
fulness of Rosenow's schema. Both plans referred to above, inalce 
use of the fact, that usually the solution of such problems as have 
been indicated before requires only one regression equation. 

The witer has devised a schema for solving problems in partial 
regiession which involves the finding of fewer cocHicicnts than 
either oi the two plans cited before nnd at the same time avoids 
the approximation of Kelley's plan and the indeterminate signs of 
Kosenow^s plan. 

Nuifniun OP coBPPiciiiiNTS iiKQUinroD* 

Variables This plan Yule Kelley Rosenow 



Par. 

MuU 

Par. 

Mill. 

Par, 

Muh 

Par. 

Mul, 

3 

2 

2 

3 

1 

2 

1 

2 

2 

4 

9 

2 

19 

1 

15 

1 

0 

3 

5 

22 

2 

61 

1 

3G 

1 

22 

4 

6 

46 

2 

240 

0 

78 

1 

45 

5 


This plan ia outlined below. In the outline it ig assumed that 
the reader has a working knowledge of the theory of correlation 
and of the notations of partial correlations as given by Yule. 

The general problem before ua is: given a dependent variable 
and a number of independent variables how can the maxi mum of 
information be obtained with the minimum of arithmetic? This 

'Y«le, G. Undy; An IniroilitoHon lo the Theory of f^iatiaiics. 1010. 

/KeUiiy Truiimn b.: Ghavt fo Facilitate the Caloulatlon of Parilut Coeffi^ 
cieiitfl of Goi’relatfon and iicpieaslQii Ki/iirt li[»i8j 

Vol^^^XxTv'1^0^1017^ duff/i/fl/fi of Mental Fufietioua, Psych. Moiiofrrriplifl, 

^Sjumlior of cooIllelGnla nccilca for Kolley'e and l^o8cno^v'H pinna Is from 
Boaonow op.clt. 
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problem may bo divide cl into two sub-problems which are succes¬ 
sive stagcis of a single operation- The two staj^es are: (1) The 
finding of the coo file ieuts of partial correlation, with reference to 
the dependent variable, of the highest'order; (2) The finding of 
the coeflicients of regression (weights) for estimating the depend¬ 
ent variable. 

In a problem involving four variables, the tables given below 
include all the partial correlation coeflicients of nil orders needed 
for finding the coeflicients of the highest order with reference to 
the dependent variiible. 


riTHt (IrtllT 
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31 

23 
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.SoooihI OrOor 

Muy 
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Order CoedlcleiUs. 

Ni'L‘(h>d 
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12.34 

12,4 

13.4 

23.4 

r 

r 
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13.21 

13.4 

12.4 

23.4 

r 

r 

r 

r 

14.23 

11.2 

13.2 

31,2 


The regression equation to be used in esLimaling the dependent 
variable is. ^ ^ 

1 *2 I'i/J-Jr a 14.2n -i 

In which Xi is the estimated deviation from the mean of variable 
1; Xz observed deviation from the mean of variable 2 etc. 

In addition to the coeflicients given above the four standard de¬ 
viations of the typo <^1.2S4 will be needed. Each of these may be 
found in threo di/Terout Avays, for exainplo ^1,234 may be found 

from: !i 2 2 2 2 

(T (l-r ){l-v Hl-r ) 

1.2a4 1 12 13.2 14.23 

2 2 2 2 

-a (l-r )(l-r )(l*r ) 

1 14 13.1 12.34 

2 2 2 2 

( 1 -r ){l-r )a-r ) 

1 13 14.3 12.34 


It is now possible to select formulae for the standard deviations 
needed in such a way that all the coefficients used occur in the 
tables of partial coeflicients given above. The formulae selected 


in this case are: 


<r =47 ( 1 -v )(l-r )(l-r ) 

1.234 1 12 13.2 14.23 


"2 

47 

2.134 




m 


huffaickh 


2 2 2 2 2 

(T -a {1-T ){\‘T Wl-T ) 

a.m ‘ n u 23.1 in.24 

I) (> C) o Cl 

0 *' rr/d-r )(l-r'^ 

4.i2;i 4 24 ari - i‘i.2a 

As a checlc on the arithmetic of the opcrfitioii, it ia wcW to find 
multiple R in two dilTerent ways, namely by 

l-R = 0 - a-r' )(l-r‘' ) 

1(234) 12 13.2 1-1.23 

2 2 2 2 

l-n =(7 {hr xi^r )(l-r ) 

1(234) 14 13.4 12.31 

This furnishes an absolute check on all the work except Chat of 
ria.ai and the coefficients that are used in rinding* it nre checked 
for their accuracy. There is no chock on the arithmetic of the 
stand deviations included in the plan. However, if a chock is de¬ 
sired, they may be found from the following equations, after r,,., 
has been calculated from I’ai, ran, and rjj. 

2 2 2 2 

a (1-r" )(l-r Xl-r" ) 

1.23-1 1 U 13.4 12.34 

2 2 2 ^’ ^ 

a {X t ) 

2.134 2 23 24.3 12.31 

2 2 2 ^ 
u" (l-r )(l-r‘ )(I-r" ) 

a.l24 a 23 31.2 13.2-1 

2 2 2 2 

a —a (l*r HI-** )(l-r^ ) 

4.123 4 3-1 24.3 14.23 

In using this plan it should be hold in mind that the different 
partial coefficients are obtained from the column headed ‘^May be 
obtained from*' by substitution in the general formula 

r r .r2n . 34 .. (n-1) 

^ 12.34 ■ (n-D- ln.34 ■. (n-i) _ 

12.34 . . Ti I-}- 


l-r 


In,34 . , (n-1) 


l-r 


211.34-,. (n-1) 


In each case, the first coefficient given becomes the first term of 
the numerator and the second and third the product-term on the 
numerator. The second and third coefficients likewise appear in 
the l-r^ of the denoTninator. For example: 


r - r . t 
12 14 24 


r ----- 

./ 2 

^ 1 2 

-yJl-T 

V |l-r 

V H 

V 24 

r - r 

, r 

^ _ 12.4 13.4 

23.4 
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The legreasion coeflicienta are obtained by substitution in the 
general formula 

b —r \234,..n 

12,ai,.n 12-34..n- 

For example bu.j, and bu.ji are given by the formulae 

h =r ^1.234 

12.34 12,31- 

a 

2,134 

h =r ^1.234 

33.21 13.24- 

cr 

3.124 . 

For five variables the equation becomes 

X =b X X 4-]) X +b X 

1 12.343 2 13,245 3 14.235 4 15,234 5 

and may be solved by the following outline using the same checks 
given for four variables, afLcr extending them to include the extra 
variable. 
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Second Order 
Cocfficiejita 
Needed 


May he obtained from 
I* irat Order Coefficients 


'^12,43 

" 12.5 

*^14.5 

"^24.6 

"^13.45 

r 

13,0 

"^14.5 

^34.6 

'^14.23 

14.2 

*^13.2 

*^34,2 

*^15.23 

^5.2 

^13.2 

^36.2 

*^23.46 

23,0 

24.6 

^ 34.5 

^45,23 

4G.2 

35.2 

*^34.2 

Third Order 
Coeflicienta 
Needed 

May bo obtained from 
Second Order Coellicients 

"^12.345 

^2.46 

"^13.45 

'^23.45 

^13.246 

'iS.dS 

*^12,46 

"^23.45 

"*14.236 

14.23 

*^15.23 

^45,23 

**15,234 

16.23 

‘ 14 . 2 a 

^45.23 


The formula, for the .tomlord dovlatlonj oro 

I^ormulae for the b's are 

b =p lTl-23^r■! 

12 ,a.Io '’12.343 a2.i:)4D 

b 

M.2-15 ia,215 <,3.121,-3 

elc. 
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The equation for «ix vanublc-s is: 

X -b X -hi' ^ 4 +b X ^b X 

1 i2,rtir,(v ^ vv2in\i :i wzm /i in,2a-!o 5 a 

The pbin for six variables is given below and is subject to the 
same chech.s nij the prohicuis with n ftmoilcr numbei* of variables. 
I'ist Order May be obtained from 

CoefUcients 2ern Order Coefficients 

Koedeil 


r r r ]’ 


12.6 

12 

10 

20 

r 

r 

r 

r 

13,2 

13 

12. 

23 

r 

r 

r 

r 

13.fi 

13 

16 

36 

r 

i‘ 

r 

r 

J42 

14 

12 

21 

r 

r 

r 

r 

14.G 

14 

1C 

46 

r 

r 

r 

r 

15.2 

15 

12 

26 

r 

r 

r 

r 

15.0 

15 

16 

6G 

r 

V 

r 

T 

16,2 

16 

12 

26 

r 

V 

r 

T 

23.G 

23 

2G 

36 

1’ 

r 

r 

r 

24.6 

24 

26 

46 

r 

r 

r 

r 

25.6 

25 

26 

66 

r 

Y 

r 

T 

34,2 

34 

23 

34 

r 

r 

!• 

t 

34.C 

34 

31) 

46 

r 

r 

)' 

r 

35.2 

36 

23 

25 

r 

V 

r 

V 

35.6 

35 

36 

66 

1' 

r 

i‘ 

V 

36.2 

30 

23 

26 

r 

r 

r 

r 

45.2 

45 

24 

25 

r 

r 

r 

r 

45,0 

45 

4G 

66 

v 

r 

V 

r 

46.2 

46 

24 

26 

z- 

r 

r 

r 

56,2 

GO 

26 

26 

Seoond Order 

May be obtained from 

Coefficients 

First 0 

rcler Coefficients 

NoGcied 




j* 

r 

r 

r 

12,0G 

12.fi 

15,0 

25.6 

1 ’ 

V 

r 

V 

13.6G 

13.6 

16. G 

35.6 
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*^14.23 

*^14.2 

'^13.2 

*^34.^ 

^14.B6 

*^14.6 

"^15.6 

%5.(r 

^15,23 

"^15.2 

"^13.2 

*^35.2- 

1C.23 

^^16.2 

'^13.2 

*^36,2' 

^23.6G 

*^23.6 


"36.G 

*'24.66 

24*0 

^26.G 

*^46,6’ 

*^34.66 

^34.6 

"^45.6 

*^35.6 

**45*23 

45.2 

'^35.2 

*^34,2 

**46*23 

'*46,2 

"^34,2 

36.2 

**56.23 

'^66.2 

*^35.2 

'^30.2 

Third Order 

May be obtained 

from 

CbefTicients 

Needed 

Second Order Coefficients 

*^12,356 

r 

^2.50 

*^13.66 

*^23.BG- 

12.463 

r 

*^12,56 

*"14.66 

*^24.56' 

13.456 

1* 

^13,50 

*"14.66 

*^34.60 

14.356 

r 

14.66 

^3.66 

34.56 

15.234 

I* 

"^15.23 

*^14.23 

*^45.23 

16*234 

r 

*^16,23 

*^14.23 

^46*23 

23.463 

r 

*"23.66 

24.56 

*^34.56- 

24.353 

r 

*"24.56 

*^23.56 

^34.50 

66.234 

56.23 

*^45.23 

*^46.23 

Fourth Order 

May be obtained from 

Coefficieni^a 

Needed 

Third Order Coefficients 

12.3466 

r 

"l2.466 

”^13.466 

*^23.466 

13.2463 

r 

13.456 

"^12,456 

'^23.456 

14.2366 

r 

^4.356 

12.366 

24.366- 

15.2343 

r 

\5.234 

16.234 

*^66.234 

in.2345 

16.234 

15.234 

r 

66.234 
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Formulae for stnndard deviations, 

0 e 1! 'e 2 2 2 

/ (hr )(l-r )<l-r )(l-r Hl-r ) 

1 in 15.11 H.riO j.'vijij is-,Dine 


<) i; M 


U -a (I->- )(I-r )(Lr )(l.r Kl-r ) . 

2 ,l.Djn(l 2 2(1 2 **,() 2 ini) I'.'l.Mfl 12.,'i-infl 




Id 

*) 

0 •) <) 

It 


)(U 

id-r' 


^ -Hi M 

5.0 

2 

0 M J 

•J 

— 

■cr (1-r )|l-r" 

)(l-r‘ 


5 ’Jo :j; 

1,2 •iri.cii 


0 <J ti 

2 


r/d-r" )(!-r' 

){i-T 


(1 211 III 

li,2 '10.211 


Formulae for tlie b's are: 


irl.2;i-l,1ll 


li =:r 




i:i.2irji)~ iii.2ir.(i ffD-iainii 
cte. 

The same ])lnn of selection can be used for any number of vari¬ 
ables with tho same proportionate saving of labor, The use of 
Kelley's Chart referred to before is possible with four variables, 
but is not recommended for more than that number. For five and 
six variables tho writer recommends the use of such tables as 
Miner's' and a calculating machine. By the use of these tables and 
a calculating machine it is possible to solve a problem of six 
variables correct to four places in three hours, after the Zero Order 
CoefEcients have been found. 


2 

^Mmer. Tttfilca ol 1 -f 


-^2 

aiifl ’ l-r JoliTi Hopkins Presa, 192?!. 



THE RELATION BETWEEN THE INTELLIGENCE: 
AND VOCATIONAL CHQICES OP HIGH 
SCHOOL PUPILS 


By Gustave A. Fkincolu 
Hartford Public High School. 


In the varied literature on vocational guidance and vocational 
education, one finds that almost nothing hna been done in the at¬ 
tempt to correlate the vocational choices of high scliool pupils with 
their montaliby.'^ Yet if vocational guidance is to be put on a 
scientific as \veli as practical basis, this is the very first thing that 
should be done. The chief function of the vocational advisor in the 
high school should be to save pupils of high mental ability from 
entering occupations of limited opportunity^ on the one haiid^ and to 
advise others of little ability ngniiist trying to enter occupations 
for which they have not the intellectual foundation, on the other 
hand. 

In the September 2, 1922, issue of Schciol and Society there ap¬ 
pears TiTi article on Occupational-Intelligencc-SUvndards" wherem la 
presented an intelligencG scale grouping some ninely-six different 
occupations into various Army Alplm scores» based on the results 
of the occupational studios made by the Division of Psychology, 

S. G. Om niid reported in the now famous Volume XV, Memoirs of 
National Academy of Sciences. 

'With Lhig Oceupational-lntelligcncc Scale before us, there was at 
hand n means for comparing the vocational choices of high school' 
pupils vijith thelY intElligeTice gindes, in oTder Id lietiirniiiiD whother 
they overrated or underrated their abilities, and to what extent. 

All occLipational-intelligence scales are based on the asaumptioii 
that certain vocations are within reach of certain mental levels. 
One group of vocations is within reach of “A” intelligence, another 
within reach of intelligence, and so forth. If a high school 
pupil of a certain mental level, '*1),“ let us say, desires to enter a 
vocation which belongs to a much higher level, like "B*’, he over- 
estimates his ability by two degx'ees. The assumption is that he 
will either not succeed in entering his desired vocation, or if he 
does, the probability is that he will not be efheieut in it. On the 
other hand, if a boy expects to enter an occupation that belongs to 
a much lower mental level than his own, the community loses by 
that choice, inasmuch as it does not get from him the host and 


'In 183 titles ori!Z7|c Psychotofii/ af T'oc^Uoiiai iScIrcftoii i’t*vl<i\vcU by A. 

Vol. H), Ko, J, 1022, not one «(!L‘niH Lo deal Hpe- 
clflcfilly with the (iliovo pvQblcm. 

Siandarda, School iiin] Society, 
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utmost sorvicQ that he is cnpable of I’endering, nor will he be happy 
because he will nob have the full opportunity to express his entire 
personality in it. This is an important matter, for about 60 per 
cent of nil high school pupils make up their minds with respect to 
their future calling even before they enter school^ and about 80 
per cent of these cling to their original choice throughout their 
school enroer. Our problem, therefore, was to find out to what 
extent high school puinls make or express vocational choices that 
are within reach of their mentality. 

To be sure, the alpha scores given for the various occupational 
groups in Fryer^s table were attained by individuals whose school¬ 
ing, for the most part, lay from five to fifteen years behind them; 
and, in view of the fact that when the youth gets out of school 
he is bound, more or leas, to get into n rut of thinking and acting, 
it ia inevitable that he should strike a lower score in an intelli¬ 
gence test then, than he would have done when he was at the 
height of hia school daya.^ This is demonstrated by the fact that 
in the relative mental ranks of the various occupational groups in 
the afore-mentioned Volume XV, the student’* is placed third 
from the top, apparently above the physician, above the clergyman, 
and above the accountant, noUvithstanding the fact that all of 
those have been students at one time in their lives,^ Consequently, 
a certain amount of caution hnd to be exercised in comparing the 
intelligence grades of high school individuals with those of mature 
persons in various occuptilional groups. For, a high school senior 
may readily score 127 points, which is the average for the physL 
dan group on the Occupational-Intelligence Scale referred to, and 
yet be woefully deficient in mentality for the medical profession. 
In other words, his relatively high score may bo due to the educa¬ 
tional increment, which 5s bound to innure to high school pupils 
of every grade of mentality by virtue of their constant immersion, 
forced or otherwise, in the educational waters.® It was, therefore, 
necessary to strike n group of high school pupils not too long domi¬ 
ciled in the realm of secondary education, on the one hand, and 
among whom there would be found a mental level that would corre¬ 
spond, in points scored, to the mentality of some definite occupa¬ 
tional group in Fryer's scale, on the other hand. 


^Slnco Llio fiboVC a\*(is M’riUon V, C’ol)l]’5i The Limits Set to ZJrfu- 

pdtlfjnai Arhlci'r?t\rnt hy Lifulicfi /nfcUif/eticc, Joiir. 13tlnc. Pay. Vol. XTII 
No. 0, 1022, luis miulo Its? apia‘iii’iincti iiiul from the Upurca prosentod lu 
'i'llbio Vlir, ono may fnfov tluit those: who Imva had only oin^ yoar of IilgJi 
school c line III Ion, will, lo years liilov, score no veil points more tliaii they 
tlkl as IiIkIi sell 01)1 froHliineii, those who left high school at the end of the 
sophoniore will, jr> ,vwir‘.y hilcr, .score fli'c pohilM le.sa tJuin as eopho- 

moroK, aniil'lK of tlu'ci'- yeiu'H’ high school training will score 10 less llinn 
they did aw junlorti iiiul those of four years lilgll school will score 20 polrita 
Icsa than they rthl as high school kchLovs. 

‘Mom. Nnfc. Ac So. Vol. XY, p. 8:hl, 

“li’or of tliJa see Oobh Op. ell;, p. 402-lOh. 
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Now ifc happened that in Juno, 1D22, all prospective Freahmen of 
the Hartford Public High School, Bome 1200 in number, were given 
o modified Army Alpha test niid the pasaiiig mark wag set at 70 
points, equivalent to an I. Q, of 103 and to 50 per cent intelligence 
on our scale of 100. By dividing that scale into ten deciles, the 
uppermost, or "A" mental level, corresponded exactly v/ith the 
occupational groups that fell into the '’A'' mental level on Fryer's 
scale. Thereafter, ifc was merely necessary to draw lines through 
all corresponding points of division on the Fryer scale and note 
whether the vocational choice made by n pupil of n given degree 
of intelligence fell within his mental level on the converted- bcrIc 
or not. 

In one respect Fryer*3 Occupational-Intelligence Scale is unsatis¬ 
factory for high school purposes in that it is not sufFicieiitly com¬ 
plete in the matter of vocations. No provision is made in it for the 
professions of law, banking, journnlism, high school and college 
teaching, nor for teachers of music, gymnastics, and cooking. Tet, 
there must have been hundreds of lawyers, high school teachers, 
college professors, bank tellers, not to mention instructors of gym¬ 
nastics, enrolled in the army. In an intelligence test given to fifty- 
live high school teachers, the writer found that theiv median on the 
Army Alpha test was 162 points, with a variation tlmt ranged from 
04 to 190. Also, in the occupational studies made by the Division 
of Psychology, S. G. O., lawyers are ranked second from blie top. 
The wi’iter felt justi/ied, therefore, in placing lawyers, journalists, 
high school and college teachers in the "A'' class on Mr, Fryer's 
scale. Authors and bankers were placed in the modified ”B'’ group. 
Music, gymnaeiuTn, elocution, and cooking teachers, professions 
selected by high school pupils, as well as the indefinito profession 
''businGss*\ so frequently chosen by high school boys and girls, were 
placed in the modified ''D'' group. Among girls, those who chose 
dressmaking as their vocational ambition, were classified with tail¬ 
ors, and haiT-dressers with barbers. 

Investigations conducted by various psychologists have demon¬ 
strated that the I. Q. does not change appreciably. The writer has 
thus far retested two high school classes at intervals of two years 
and has found practically no change in the average I, Q. attained 
by the same pupils as Freshmen, and two years later as Juniors. 
Thus, the average I. Q. of 288 Freahmen who haj:l entered the Hart¬ 
ford High School in September, 1920, was 111; their average age 
naming been 14 years and 6 months, and the average number of 
points scored by them on the writer’s modified Alpha test liaving 

e^Pholr cducntlonnl mental limromcnt waa ubout 5 Alpljii nolnta. Deduct¬ 
ing that nnmber from 110 givoa tliem nn I. Q of 102. This llnrnlonlze.*^ with 
theory—as tlio normal ItiaivUluiil nPDconeUea a dull inenUiUly bib I. Q. 
should approach 100, 
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been 30, v/hich i.s eciiiivnlenl to a mental age of 10 years and 2 
months, TJio avcraffo number of i^oints scored by these same 288 
pupils in September, 1922, ^vhen they became Juniors was IIG, 
which is cf|iiiviilenL Ln the mental age of 17 years and 1 month; their 
average L Q. was conscquciiUy lOd," 

By ndoplini? a pcsrccnlaEc scale of nienliil alertness, the base 
of whicli is 152 points, equivalent to 100 per cent i nielli gene e, for 
high school Freshmen tested three weeks before graduation from 
gruminar school, ami a scale with a base of 172 points for Sopho- 
moresj one with a base of 18G points for Juniors, and one with a 
base of 196 points for Seniors, the latter three groups tested at 
the beginning of their class careers, the writer has found but little 
displacement from one mental level to the other as the pupils 
progressed from the Freshman to the Senior year and were sub¬ 
jected to two separate tests. 

Thus, the average per cent of intelligence for the above men¬ 
tioned 288 pupils, rated by their Freshman scores, was 59.0, and 
their average intelligence two years afterwards, rated by their 
Junior scores, was 62,3. The coefheient of correlation between the 
Freshman and Junior scores was +.875±.009, Fifty, on a scale of 

100, being the minimum requirement for passing our high school 
intelligence test, the corresponding passing 1. Q/s for the Fresh¬ 
man, Sophomore, Junior, and Senior classes are, respectively, 103, 

101, 98, and 95, The following table gives the points scored, per 
cent intelligence, and letter grade for each mental level in the four 
high school classes, 

TABLE I. 

COMP All ATIYE INTELLIOBNOE SCALES POR HIGH SCHOOL 
CLASSES. 


(To bo nppUef] Lo Mi© insL tbreo nt tbo bD^Junbig of tboir clnsa carcorfl) 
POINTS .SCORED 

Fresh- Sopho- Letter 

men 

mores 

Juniors 

Seniors 

% Int. 

Grade 

137-152 

1B6-172 

167-18G 

176-19C 

90-100 

A 

121-136 

188-154 

148-166 

166-175 

80-80 

B 

106-120 

120-137 

130-147 

136-155 

70-79 

C 

91-105 

103-119 

111-129 

llG-135 

CO-69 

D 

76-90 

86-102 

92-110 

96-115 

50-59 

E 

G1-7B 

69-B5 

74^91 

76-9B 

40-49 

P 

4B-G0 

68-68 

65-73 

56-75 

30-39 

G 

44 & Less 

B1 & Less 

54 &, Less 

65 & Loss 

29 & Leas 

H 


If now we take Fryer's OccupiiLional-Intelligence Scale, modified 
so aa to include the professions frequently chosen by high school 
pupils, and then group into the various mental grades the profes¬ 
sions that naturally fall into them by virtue of the average points 
scored by the members in each group, we obtain the following Oc- 
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cupatioTinl'IntolIigcncc Scale especially inlaptetl for school 

pupils,-anti, though based on the iiilclligeiico achievements of high 
school Freshmen, is none the less applicable to upper classmen, 
when attention is paid to the letter griule in inentality instead of 
points scored. TABLE II. 

OCCl!PATlQNAL-lNTKt,td(;i:x(’K FOIL ItniU SFUOOL 

ITPihS. 


Letter 

Ay. 

Av. Noi 


Grftdc 

I. Cl’ 

Points 

Occupatuni 



1021 


Teacher (College & Iliffli) 



161 


Enpiiicer (Civil (S: lilecli.) 

A 

12G 

? 

Ml 

Lawyer 



7 1 


Jmiriiali.st 



152 


CkvRyman 



137] 


AccounlaiiL 



127' 


Phy.HiciHii 





Novelist 

13 

122 

122 

126 

Teacher (Grades) 



■9 


Hanker 



119. 


CUemiftt 



114^ 


DraCtsman 

C 

116 

111 

110 

Sccrclary (PriviiLc & Institutional) 



110 


Dentist 



109. 


Executive, minor 



103^ 


StciiORmplicr Typist 



101 


bookkeeper 



09 


N ursc 



90 


Clerk (ofTicc) 

D 

110 

91 

96 

Clerk (rnilroiid) 



■/ 

’ 

'^Business*' 





Gymnasium Teacher 





Cooking Teacher 



■? 


Music Teacher 



? 


Elocution Teacher 



86 


Photographer 



85 


Telegrapher & Radio Operator 



82 


Musician (Band & Orchestra) 



61 


AtIIbI (Sign LetteiGr) 

E 

103 

81 

. 80 

Clerk (Postal) 



81 


Electrician 



80 


Foreman (Construction) 



78 


Druggist 



77 


Foreman (Factory) 


■*DDr\Yi>Q Irom the FreBliinen scofcb and ngoB In eiieli group. 
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Tclaphone Operator 
Carponler (Ship) 
rolicoiiian & Detective 
Auto Agfjcnibler 
Tool iltaiicr 
IMiimbcr 

Luth Ilnnd (Production) 

AuLo Mcchfinic (Gcnerpl)’ 

Auto CliaipllDur 
Tailor 
Dressmaker 
iHil liner 

Machinisjfc (General) 

Actor (Yaiicleville) 

GO Printer 

GO Carpenter (General) 

no Painter 

08 Farmer 

G 00 68 l>5 Prick Layer 

67 Caterer 

65 Dnrber 

V Hair Dresser 

62 Sales Clerk 

dO'l Hospital Attendent 

H 84 321 36 Snilor 

31J Structural Steel Worker 

Not all of the occupations fi^iven in Fryer's scale are included in 
this modiricd one. Only Ibosc which were chosen at Jensb once 
among' the 512 pupils who expressed their vocational preference 
are given a place in it. These itre printed in heavy type. The 
remaining occupations arc inclnded ag ones which the writer 
thought high school pupils might possibly choose, at least tempo¬ 
rarily; also in order to serve ns a niemis of comparison between 
the difTerent types of vocational mental levels. 

Let us nov/ see what the 512' high school Freshmen actually did 
in the matter of choosing a vocation or indicating a vocational 
preference. Table III shows the degrees and the dmectiou of vari¬ 
ation of vocational choice from mental level among the 260 boys, 
The numbers -h6, -M> +3, etc., represent the number of mental 
levels, above that of the individual, wherein lay the vocation he 
chose. Minus one, —2, etc., indicate the number of mental levels 


70^1 

Gb 

Gf) 

G8 

07 

no 

F 05 05 I 06 

05 
05 
05 
•} 

7 

G3 
G2 



149 


FEINGOLD 


Lelow that of the individual wherein lay the profession he selected. 
The letters in the squares show in what nicnlnl level lay the voca¬ 
tion chosen; the numbers in the squares represent the numbei* of 
pupils making' that choice. 

The above table snows some astonishing results. There is a 
conspicuous tendency for the superior pupils, those of "A"' and 
"'B” Tnentalityp to iindcrraLe their ability ami to choo.se n profes¬ 
sion that falls in a mental level considerably below their own. 
And there is a still greater tendency for pupils of low mentality 
to choose pL’ofcssions that lie considerably above their mental 
levels. To be sure, the choosing of a profession that lies within 
one inental level above or below the one to which a particular indi¬ 
vidual belongs is no serious mi stake. It is perfectly safe to assume 
that an individiml of "B” mentality is quite able to pursue n pro¬ 
fession that lies in the menial level, provided he puts forth 
enougVi industry. Likewise, there is no reason to suppose that a 
pupil of "C” mentality is throwing his future away entirely merely 
by choosing a profession that beloiig.9 to the “D’' mental level. 
Therefore, in the treatment of the (lata presented in Tables III and 
IV we shall consider all individuals who vary but one degree in 
either direction as having mode a proper vocational choice. It is 
only those whose vocational choice lies within two or more mental 
levels above or below their own who will be considered ns not 
having chosen wisely. 

With this proviso before us we find that of the thirty superior 
boys only 20, or G6.G per cent, make a proper choice, whereas 33.3 
per cent choose some profession that requires far less ability than 
they possess, as judged by the intelligenGe teats. Of course, for 
the pupils, there was no alternative but to choose a profession 
that lay either within their mental level or in some lower level; but 
why should three of the four boys choose vocations that are so 
far below their own mental grade? The pupils seem to show 
somewhat more courage, as well as more wisdom, than the 
individuals, in choosing their vocations; inasmuch as 73 per cent 
of them select vocations that fall within their mental capacity. 
Among the boys of “G" ability only 44 per cent seem to make a 
proper choice, while the number that overrate their ability is 
twice as large ag those who underrate it. When we come to those 
who failed in the intelligence test's, having scored a grade of “F'* 
and lower, which is equivalent to 76 points and less on the Army 
Alpha scale, we find that no less than 88 per cent of them select 
professions that are anywhere from two to five mental levels above 
their own. 

To be sure the claim may be made, and justly too, that the so- 
called professions lie within the three highest mental levels, and 
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inasmucli ns ilic very presence of boys in liie'li school alrc^idy 
indie ales a leaning toAvard some profession, it is only natural that 
they should tend to overrate their ability, as judg‘ed by their voca¬ 
tional preference, rather than to underrate it. But this simply 
shifts the arginnent back one step by taking the problem out of 
the high school and placing it within the grammar school and home, 
ft merely moans tlial American cIiiMren lend to overrate their 
ability even before they get into higli school. Judged by the large 
proportion of high school failures, it being .sometiling like 60 per 
cent, one musL say that the above statement is not far from being 
accurate. Moreover it is significant to note that among the mental 
failures a larger proportion, fully 48 per cent, choose a profession 
that lies in Che and levels than flo the pupils of either 
or ability, the percentages of excessive vocational over¬ 
reaching in their cases being 40 and 42, respectively. In other 
words, the distribution table plainly shows that the lower an indi¬ 
vidual stands in mentality, the higher seems to be his vocational 
ambition. Whether this is a manifestation of compensation, the 
desire filling the gap within the mind, or whether it is simply a 
further indication of poor judgment and inability to envisage the 
future in matters practical as well as ideal, is a topic for separate 
discussion. 

Nevertheless, there is sulTicient evidence at hand to indicate that 
it is the latter and not entirely the former. Investigating the pro¬ 
portion of pupils in the various mental levels who survived the 
high school curriculum for at least two years, the writer has 
found that iu the Hartford Public High School fully 73 per cent 
of those who fail in intclJig’once at the beg'innin^' a£ their Fi’eshman 
year do not succeed in becoming Juniors. Either they drop out 
of school altogether, or remain in a lower class because of poor 
scholarship. According to Cobb,^ 87 per cent of the Freshmen who 
score below 77,5 points drop out before the Senior year in the 
Michigan high school.s, and in Madsen's group about 84 per cent 
of such individuals drop out. Now, in view of the fact that the 
professions within the "A” and “B" groups require considerably 
more than mere high school training, it is quite obvious that of the 
thirty-seven *‘F'’ and “G’’ mental level pupils who selected profes¬ 
sional occupations foi' their career, practically three-quarters of 
them will not proceed far enough in higher training even to come 
within reach of a high school diploma. Once more according to 
Cobb, only about 4.6 per cent of them may be expected to enter 
collegG.® 


‘'Thv Titmit ►sV;/ (t) Athlcvcmcnt hy lAmitciI InicUitjencc, Joiir. 
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TABLE III. 

DEGRE^i AWn DIHECTIOI^ of VAHIA'l’lON OV VOCATIONAl. CHOICE 
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TABLE IV. 
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To judgo by the professions these 250 boys wish to,c)iter, we 
mny sny Uuifc Ion per cent overrate their ability five mental 
levels, oig'lih per cent overrate tboniaelve.s by four mental levels, 15 
per CGiit by three znental levels, anfl 1*1 per cent by two mental 
levels. Ill brief, <18 per cent of all the boys overrate their ability 
by choofjinpf ti ])rofossion that lies in a mental level that is from 
two to five formica aizove Ihoir own. Forty-three ami two tenths 
per cent seem to choose wisely, in that the profession they select 
lies within a mental level that varies only one (lep;reo from their 
own. Eig-ht anil cipfht tenths per cent unilcrratc Lhoir ability by 
choosing a vocation that lies in a mental level which is two or 
more grades below theirs. The coclficient of correlation between 
the intelligence and voentioniil choices of these 250 boys ‘is 
-i-.O'lQ :2r.0<l2. Practically ;?ero. 

Fryer’s OcenpalioiiiiMiitelligcnce-Scale docs not lend itself very 
readily for the classificfition of girls in the same maimer ns 
boys, for the very good reason that the occupations considered 
are chiefiy those for men. Nevertheless, it contains the profes¬ 
sions of teacher, sLonogrfiidior and tyinst, bookbooper, nurse, and 
clerk, which constitute nearly t)0 per cent of the professions 
selected by high school girls. By incliuUng the professions of 
music, cooking and gymnasiiun tcauhors with the class of boolc- 
keepers, hurseo and sLcnographcrf;, us wo have done, wo have, it 
seems, mnclo provision for prficticnlly every profession that a 
high school girl would be likely to choose. With these additions, 
we wore surprised to direover that of the 2G2 g'iids, who indi¬ 
cated tlicir professitiiuil choice, only one selected a vocation for 
which no provision could bo made on this modified Occupational 
Scale, and that one was acting, presumably in drama. Tabu¬ 
lating the girls in the same manner as we did the boys, we obtain 
Tabic IV. which shows the extent and the direction in which their 
voccitional choice varies from their mental level. 

The similarity in the distribution curve for boys and girls is 
remarkable. Here, too, we find that 45.8 per cent of the girls 
overrate their ability by choosing vocations that lio within two 
or more mental levels above their own. Forty-eight and one 
tenth per cent make n proper choice and 6.1 per cent underrate 
themselves. The c^ieflicient of correlation between intelligence and 
vocational choice for the girls is -I-.0D87 it.041. In spite of the 
fact that the scale was based on vocations pursued by men, wc 
find that it is applicable to girls, and, indeed, girls seem to 
choose their vocations a little more intelligently than do the boys. 

Before summing up the results of our study, wo must once 
more forestall the probable objection that the reason why these 
pupils tend to overrate themselves by choosing vocations that 
lie so high above their own mental levels is because their in¬ 
telligence baa been judged too early in the stage of mental de¬ 
velopment, There is no ground for such criticism. Firat^ be- 
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caMse the average mental age ol tUese pupils was l.) yeai-s aad 
G months their nveruRe I. Q. 107. This is considerably higher 
than the average niental age and 1. Q. for the A in eric sin popula¬ 
tion ay a ^vhQlc. In the Rccoud pUiee, thn "A" mental group 
these pupils coincided exactly with the '*A" group on the Occu¬ 
pational-Intelligence Scale ill the number of Alpha points scored, 
None of the deciles in the higher cUuisea could bo so compared with 
the mental groups on Pryei-’s OccupulioiuiMiiLolligoiico Scale. 
Thirdly, an intelligeiicn lest given to 105 evening high school 
pupils, all of whom were gL-ammur school graduate a, iiomc of 
them being college graduates, some grammar scliool teachers, 
one professional nurse, three machinists, and most of the others 
time-keepers, bookkeepers, store dories, and nnice o 1 orks yioldeil 
an average score of 90 points, which is only five pointa above the 
average for the 512 high school Freshnujii considered in the 
above tables. Fourthly, the average iutclligoucc of ouu “D'* 
group (05 ]3oinfcs) is about equal to that of adults who had one 
yenr of high school training and wore LesLod lo years later.^^ 
The avoragci of our ^^C'’ group is ctiuul to that of adults who had 
gone through Junior year in high school and were tested 15 
years out of school. The average inielligoiieo of our “B” group 
is higher than the aver.age intelligence of adults wlio had boon 
graduated from the high school or who had hocMi college fresh-, 
men and were tested 15 ycav^i Inter. With vaspect lo the “E” 
pupils, investigatioiiB have thus far shown that not more than 30 
per cent of them siicceod in hcconiiiig high school seniovK. 

CONCLUSIONS. 

The above study leads to the following cuuclusious: 

First; Only about 46 per cent higli school pupils mnko 
proper vocational choices—choices that can be realized by thoni and 
which they will pursue with maximum saLisfnetion and cfticicncy. 

Second: About the same number, 47 per ceoL, make vocfitioiial 
choices that lie cousiderably beyond their nienbul reach. Pre¬ 
sumably, this proportion of pupils will eithor not gain their de¬ 
sired vocations or, such as do, will not be entirely efllcient in 
thftYv. 

Third: Approximately 7 per cent underrate their ability by 
choosing vocations that lie considerably below their own inentnl 
level. 

Fourth: It would seem advisable, therefore, thnt the first 
duty of the high achool vocational guido or vocational educator 
should be to acquaint hiniseU with the intelligence of the 
pupils to whom he would give vocational advice. 

Fifth; Viewed from the social stnndpoinl it cannot bo said 
that the American youth is devoid of ambition, lie may not 
ahvay.s put forth the necessary effort to realize his aim, but, 
judged by the goal that he sets for himself, he certainly has far 
reaching desires. 


«f'oJib, Oil. ti\t. Table S. \\. UJO. 



DELATION OF MENTAL ALERTNESS TEST SCORE 
TO POSITIONS AND PERMANENCY IN COMPANY 

By Marian A. Bills 
Bureiiii of Pci*soiinel Research. 

CarnQgic InsLitutc of Tcchiiolog^y, 


Three year a i\f^o Llie Bure/iu of Person hgI lie-search Carneg-ie 
Institute of Technoloj^y, ffuve a menial alertness test to a large 
clerical force. The total results Avere inatle practical use of by 
the firm. The experiment described below is simply a by-product 
of thfit investigation but holds, wc believe, several points of 
interest, 

From the test scores of tlie entire clerical group those of n 
Jiundrod tliirty-three individiinl.s worldng at live disLinct jobs^ 
were drawn off for special study. These five Jobs wore chosen 
for three reasons. (1) The jobs were all individual jobs, none 
of thorn involving supervisory dalios. (2) They represented five 
distinct levels of dilfically of work. (3) A aiilTiciently large 
nil Ill be r of iiidividiials wore wording* at c/ich of the five jobs, so 
that nil average woiikl liavc ineannig. 

Thirty mouths later the subsequent history of thofio one 
hundred ami ihirty-thvce individuals was sludicd, as'regards one 
fact, wove they still on thcs job? This gave us a perfectly objective 
criterion/ 

The date tima obtained was sLudied with the following questions 
in mind. 

(1) Is there a relation between positions in the company and 
mental alertness score? (2) Does a natural selection take place 
with time that makes this relation more evident? 

Wg would expect natural selection to take place in two ways. 
First by the persons iiiakiiig low scores in the mental alertness 
test being unable to handle high grade work and leaving and 
second by persons making liigh score.s in the mental alertness 
test bGcoining dissatisfiod with low grade work and leaving. That 
is at the end of two and a half years, we would expect that the 
average mental alcrtne.ss score of those remaining in the high 
grade jobrf would bo Iiiglicr than the average of tlie original 
group. And that the Rivera go .score of those remaining in the 
low grade job.s would he lower than that of the original group. 
In short, if mental alertness is a prominent factor in clerical 
work, wo would expect the groups to become more distinct when 

Uii UUh iiy ir» prDnmUi'iiJil or viilhi^ .systoni liiul bcnoi 

worhcfl iiui iiini iiVf)iniJllnu‘^ or ml lugs would liuvi* liccn Uio Indoiiolir a 
Cl'iU'VlOll lO ilMVO blTU VI.soil- 
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only lliQse persons arc considered tliai romnin in tlie ^ronp more 
thnii two and n half years. 

KKSUJ/rS- 

Thc correlation helwcen the nicntnl alertness score and the 
level of difTiculty of work performed by the individual was for 
the original ffroiip H-.22, for the ga’oiip roniainin^^ after two and 
one-half years +.41. That in thirty months vaiHcd the corvela- 
tioi\ 19 points. 

In order to study the oircct of natural selection in more detail, 
we have split each grade into three classes; (1) Those scoring 
above 110; (2) Those scoring between 80-110; (.T) Those scor¬ 
ing below 80. The dividing scores cho.sen are ari)ilrary but were 
taken because they seemed from the distribution of ca.scs to be 
natural breaking points. Interest centers around groups one and 
three. Group two contains about 25 per cent nf the cases and may 
be considered a neutral group. We bave loLLered the five jobs 
from A to B, A being the least diHic.nlb job, 11 being more dif¬ 
ficult than A, and less diflicnlL than C, and E being the mo.st 
difficult job, 

The following two tables give the data for (1) the original 
gTonp and (2) the group remaining after two and oiic-hnlf 
years. 

OIUGINAL GROUP. 


Grade of 

No. in 

Median 

Per cent scor¬ 

Per cent scor¬ 

Work 

Grade 

Score 

ing over 110 

ing under 80 

A 

16 

85 

20 

50 

B 

15 

77.B 

20 

53 

C 

24 

105 

45 

S3 

D 

56 

103.5 

46 

30 

E 

22 

118.6 

50 

13 


GROUP REMAINING THIRTY MONTHS. 


■Grade of 

No. in 

Median 

Per cent 

Per cent 

Per cent 

Per Cent 

Work 

Grade 

Scores 

scoring 

scoring 

turn¬ 

turn¬ 




over 110 

under 80 

over for 

over for 
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tlio.se 
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over 110 

vindev 80 

A 

7 

G7.B 

0 

57 

100 

37 

B 

6 

80.0 

0 

50 

100 

02 

C 

11 

95.0 

27 

3G 

72 

50 

D 

26 

111.0 

61 

23 

53 

58 

E 

13 

123.0 

67 

7 

41 

GG 
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The following points would seem to be noteworthy. 

(1) In the original group the median scores of the grades 
range from ITS to 118*5, foi'ty-onc points, There are two in¬ 
stance.? where a lower grade job has a sliglitly higher median 
score than the next higher grade job. In the group remaining 
thirty months the median scores of the grades range from 67.5 
to 123.0, 55,5 points. Each grade shows a higher median than 
the grade below it. 

(2) In the two len-st difTiciilt jobs A and B, no one scoring over 
110 has remained. In the C grade a smaller per cent of the 
remaining than the original group have scores over 110, while 
for the D and E grade, a larger per cent of the remaining 
group have scores over 110 than of the original group. 

(3) Almost the opposite holds when we consider the group 
scoring below 80, There iS' a steady decrease of the per cent 
scoring below 80 with the rise of the gr.idc of work. There is 
also with one exception an increase in turnover in this group from 
A to E. 

Those results are as a whole confinned by a study of 330 other 
ciiscs from the same firm where many jobs were lumped together 
as being of the same difficulty and the grading was much less 
■carefully done. On account, however, of the inaccuracies that 
wo know entered into tlic grading, we do not believe the results 
jirc worth quoting in detail. 



A STUDY OF THE CORRELATION OF COLLEGE 
STUDENTS^ ESTIMATES OF INTELLIGENCE 
WITH THE OTIS TESTS AND OTHER 
SCALES 

By J. U. Yaubrougu 

Cnvnofi^iG Instituie of Technology, Pittsburg, Pa. 

It is a matter of common observation that eoUcgc sUidents 
Select certain of llicir number to designaLe as aiiperior, l)rigbt, 
and intelligent; ami just as fi*G[iiiently do they select others from 
their group and call Ihom inferior, stupid, and dull. Each 
Btiidenb sooii after entering college is thus tacitly iiasigned to hig 
group by his fellow students, and thereafter student conduct 
toward him i.s in accordance with this assignment, regardless of 
the method through which or the circumstances under wliich the 
judgment was formed. After observing this practice of more or 
loss unavowed placement by students in some oC our largest 
Universities, and finding it to he as common as in our smaller 
colleges; and Loo, after observing the certninLy with which u 
group of students act toward a fellow student when once it haa 
placed liim iiitellecLimlly, the writer .set about to devise some 
scheme for testing the accuracy with which college students place 
their fellows in the scale of iutelligeiice. 

In order to make thia test the judgments of a group of college 
students were secured and analyzed. The criteria used by each 
student in estimating the ability of fellow students were listed in 
terms of human traits. These traits wore used ns a basis for 
rating all member's of the class, This final rating of the students 
by the class was correlated with the rating on the basLs of their 
score on the Otis Test, instructor's estimate, and college grades. 

METHOD OP ANALYZING- THE STUDENT'S JUDGMENT, 
The student.s used in this experiment were of junior and senior 
rank. They were in a small compact college where the students 
were brought together daily in their school routine; where, in fact^ 
the success of the existing system of student self government 
depended largely upon this close contact. Moreover, they had 
been associated in this class, in psychology for a period of six 
months and had full opportunity to observe each other in class 
discussions and work in general. Their work in this class had 
been in general psychology with no special emphasis placed upon 
the topic of intelligence. 

These thirty students were provided with paper 'and pencil and 
without any foreknowledge of the content or purpose of the 
experiment were asked to answer the two questions given below as- 
the experimenter dictated Lhemi 
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1. Do you iMfike it a habit to rate one of your fellow students, 
A, as iritellig^ent and another student, B, as stupid? 

2. Enumerate the six hvunan traits whieh you most frequently 
use in rating your fellow students. 

After question 1 was given and the answers were written on the 
paper provided, the second question was dictated. The students 
were told to use all the time they wanted, but to write down the 
traits as rapidly as they thought of them. Each member of the 
class wus requested to prepare his list without communication 
with other members. This i^equest was diligently observed. At 
the end of twelve minutes all students had completed their lists, 
and were very anxious to report and hear others report. Each 
student desired to know whether or not his list if six human 
traits had been partially or wholly reproduced by some other 
member or members of the class. 

Student No, 1 wnis called upon to place on the board before 
the class the list of six human traits most frequently used by 
him in judging the intelligence of his fellow students. 

Student No. 2 was asked to add to the list on the board any 
trait or traits from his list of six which were not mentioned 
by Student No. 1, Thus we proceeded through the entire class. 
Should each student use a different list of human traits in loriU' 
ing‘ his judgments, and thereby add six traits to the list on the 
board, 3 80 human traits would be enumerated on our master 
list. But this did not happen- No one could expect this to 
happen. However, we doubt if many would think that students 

ii.se so nearly the same criteria in judgment that, of the 180 pos¬ 
sibilities only 13 were actually enumerated by the entire class. 
And under discussion of the class this list of 13 traits was re¬ 
duced to G. The 13 traits li.stcd below are given in the same 
order as they were listed on the board by the students. 

1. Quick perception. 

2. Adaptability. 

3. Leadership in -student gi-oiip. 

d. Ability to reason beyond self-interest. 

b. Mental alertness. 

G. Retention of learning—memory. 

7. General appearance and manner. 

8. Social poise, 

9. Laughter. 

10. School grades. 

IL Philosophy of life. 

12. Originality in thinking. 

13. Enjoyment of play. 
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In the opinion of Lhe class there WJis overlapping in these 
characterizations. Therefore, through consulorable discussion 
and definitions we were able, ns sin ted nbove, to reduce this list 
to six. These six trnits whicli were to form the students' master 
scale ai'o given below: 

1. Leadership among students. 

2. Impevsomil rcasouiug"—ubiUty to reason beyond one’s own 
selfish ends, 

3. Mental alertness—quickness and case with whicli novel 
material is grasped. 

4. Appearance ami manner—ability to present one's self to 
win confidence and respect. 

5. School grades: Grades on nil college courses. 

<j. Originality in thinking: Habit of thinking find doing 
things in an wnnannl way. 

A careful study of the six remaining traits rcveiils the fact 
that they, when properly defined, include the 13 former characteri¬ 
zations of the original list: No. 1 i.s included under No. 3 of the 
final list; No. 2, under 1 and 3; No. 6, under 5; and Nos. 8, 9, 11, 
and 13 under 1, 3, and 4. The class was in full agreement in 
every instance, except in the case of No. 9—hiuglitor. All agreed 
that ^‘laughter'' could be placed under "appearance and manner," 
yet throe students insisted that as ii trait tor diagnosis of intel¬ 
ligence it is too important to bo .subordinated in any way, 

THE STUDENTS’ RANKING OF THE SIX TIl/VITS 
SELECTED. 

At another meeting of this same class the students were re- 
qiieslecl to rank these six human trails on the basis of llieir 
importance in determiriiiig' intelligence. Each sLudent was pro¬ 
vided with a printed list of the six traits, and asked to follow 
directions carefully us they were read. '^Do exactly what I tell 
you. Select that one of the six human traits listed here which 
you think is of gToatest v^llLle in judging intelligence in a 
fellow student. Mark this trait ‘highest/ Now, ::c!ocl Hint i.; ^ 
of these six traits which you think is of least value in judging 
the intelligence of your fellow students. Mark this ‘lowest/ 
With this done, select that trait midway between highest and 
lowest in value and mark it ‘middle/ Select that trait now 
which is of less value than the one marked ‘highest’ but of 
greater value than the one marked ‘middle.’ Mark this trait 
‘high.' Then select a trait which is not so good as middle but 

=l)iu-ja^r tiiG Ulsens*<ifiii if miule ulnlu r,y Lbc sUhIgiiIh llial l>y 

Itaatirsumu lotisoulufi Uicy luoui^l lUc Hl>UUy U) u nroVUunv Vo its- 

without tloiulliu? Hiu ins lie liy Hie liitniHlon uL' the niu-Hoiml 

elouieiit, 
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better than lowest. Mark this one *low.’ Take the remaining 
trait of the original six and compare its value with that of each 
of the other five. Place it between those two which it is most 

When this ranking had been completed by the class and the 
results tabulated, the final six traits were arranged in the 
order of their relative importance in determining the intelligence 
of a fellow student. Their relative positions are: 

1. Mental alertness. 

2. Appearance and manner. 

3. Originality. 

4. Leadership. 

6. Impersonal reasoning. 

6. School grades. 

By accepting these six traits as the criteria for judging in¬ 
telligence we were able to use this as a master scale for rank¬ 
ing college students. 

Some objection may be offered to the acceptance of these 
traits as criteria for measuring intelligence. It may be urged 
against some one, perhaps any one, of these traits that there is 
no relationship between it and intelligence. Question:-Are these 
traits earmarks of intelligence? To what extent thesie several 
traits are characteristic of intelligence it is dilTlcult to say. Yet, 
the following two types of evidence persuaded us to accept thein 
as worthy criteria. First, they represent the consensus of opinion 
oi an average group of college students as to what they think 
intelligence is, That they had the correct conception of the 
term intelligence” we are not arguing. We do think, however, 
that they had in mind what they call ‘'intelligence/’ and what 
they constantly use in placing their fellow students intellectually, 
and their success in this placement is the aim of this study. The 
second type of evidence is found in the correlation between 
these several traits and the results of the Otis Test, When the 
students were rated on these traits, as is shown further on in 
this study, and compared with their rank in terms of the Obis 
Tests the respective value of these traits as characteristics of in¬ 
telligence is exhibited. The Otis Tests correlate with "mental 
alertness” .49, with "appearance and manner” .16, wth 
"originality” .48, with "leadership” .24, and with "impersonal 
reasoning” .38, While "appearance and manner” was con¬ 
sidered by the students as the second best characteristic of in¬ 
telligence, this trait does not seem to be important to success in 
the Otis Test. There is a reason for this. And it it this reason 
which causes many people to discounlenancc intelligence tests 
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and hark back to the practice of the personal interview. And for 
the same reason others hold that the intelligence test and the 
personal interview are mutually supplementary. 

CLASS MEMBERS RATED BY MASTER SCALE. 

a. By the Students. The class roll in strictly alphabetical 
order was printed on the left side of a large sheet of paper. 
Near the top, the middle, and the bottom of the page was printed 
'highest/ 'middle,' and 'lowest,' respectively. Midway between 'high¬ 
est' and 'middle' the word 'high' was printed, and midway between 
'lowest' and 'middle* the word Mow' was printed. One such sheet 
was provided for each of the six traits of the master scale. The 
class was directed to I'ate its members in the same way that it 
rated the six traits of the master scale on the day before. When 
the class was rated on mental alertnesSt the papers were gathered 
up. Two days later data were secured in the .same way on ap¬ 
pearance and manner. This two-day interval was allowed tlmt 
we might avoid the chance of habitually a.ssigning a man to a 
certain place on the scale. Only five of the traits wore rated by 
the students^ since the college grades were secured from the 
university records. 

By an examination of Table No. 1 several interesting points 
are observed, 1. In the judgment of the class no one student 
possessed all five traits in the highest degree. Student No. 11, 
who makes first place in three traits, is the nearest nn exception 
to this. 2, One may rank high in one trait and low in another. 
Student No. 8, for example, is given sixth place in mental 
alertness and twenty-sixth in appearance and manner, and No. 3 
ranks second in impersonal reasoning and twenty-seventh in 
appearance and manner. Students 25, 26, and 27 also indicate 
the ti'uthfulness of this statement. 

This observation is not in line with the “halo" theory as pre¬ 
sented by Thorndike, His findings seenied to indicate that those 
giving the ratings were unable to analyze out these different 
aspects of a pex-son’s nature and rate each independent of the 
others. "All ratings were effected by a marked tendency to 
think of the person in general as rather good or rather inferior 
and to color the judgments of the qualities by this general 
feeling. A halo of general merit is extended to influence the 
rating for the special ability^ or vice versa."'' While the data 
here do not indicate the presence of this tendency generally, 
yet in some outstanding cases it seems to have been operative, 

^Thoriullkp, E. L.: A Conalant L’n’or in P8tfcJ\i)iufjica1 Jlaiinas, Jour. Amil. 
Psychl., Miircli. lU^O. 
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TABLE NO* I, 


Student 

ST[M»nNT.S’ kstuiath.s OL-' 
Mental Appearance Origin- 

lNTKLni(;i-]NCl5 
Leader- Impersonal 

Rank 

No. 

Alertness 

and Manner 

allty 

ship 

Reasoning 


1 

23 

28 

21 

30 


15 


28 

2 

23 

7 

14 

11 


24 


15 

LJ 

in 

27 

22 

20 


2 


20 

d 

18 

1) 

19 

13 


0 


10 

5 

22 

17 

30 

17 


20 


25 

(i 

9 

13 

15 

21 


G 


9 

7 

19 

C 

13 

a 


11 


8 

8 

G 

2G 

IG 

IG 


14 


12 

i) 

20 

5 

20 

12 


10 


11 

ID 

12 

3 

7 

0 


5 


5 

11 

1 

4 

1 

G 


1 


1 

12 

11 

1 

3 

2 


7 


3 

13 

14 

22 

8 

19 


17 


13 

14 

27 

19 

10 

7 


21 


IG 

15 

21 

20 

25 

29 


19 


27 

IG 

10 

14 

2 

1 


3 


4 

17 

15 

23 

2G 

23 


10 


21 

IS 

24 

10 

24 

18 


30 


26 

19 

8 

15 

11 

10 


12 


7 

20 

29 

21 

29 

24 


28 


30 

21 

2 

12 

28 

20 


25 


19 

22 

28 

11 

27 

2G 


29 


29 

23 

17 

25 

23 

9 


23 


22 

24 

13 

30 

5 

27 


2G 


23 

25 

3 

24 

17 

14 


22 


14 

2G 

5 

29 

in 

28 


8 


17 

27 

4 

H) 

13 

3 


13 


6 

28 

7 

2 

4 

4 


4 


2 

29 

2G 

18 

9 

15 


18 


18 

30 

30 

8 

18 

22 


27 


24 

To show more 

fully the 

extent to which 

the 

several 

traits 

correlate with each other the table of intercorrelations is 

given 

below. 


TABLE NO. 

IL 






IN C’ 011111-l TIO NS 

Gif' TRAIL'S’. 




Mental 

Alertness 


■ Mental 

■ Alertness 

s 1 

§ i 

<y ^ 

I'B 

<i rt 

.03 

:& 

73 

c 

To 

T 

O 

.40 


“Leadership 

'rt bD 

g .S 

\n C 
f-' O 

OJ w 

£ ^ 
.5b 

Appearance and Manner 

.13 

. 

.35 


.54 

.20 

Originality 


.41 

.34 



.00 

-53 

Leadership 


.31 

.64 

.GO 



.39 

Impersonal Reasoninj^ 

.55 

.20 

.53 


.39 


Average 


.32 

.28 

.47 


.40 

.42 
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Wi(-h this group of stiidcuts “appearance and manner*’ is least 
indicative of mental alertness. In fact, the two traits do not 
appear to hold together. T^rom Table Ho, 2 we also note that 
“originality'* allows the highest while “appearance and man¬ 
ner’^ shows the lowest inter cor relation with these specific traits. 
Then “originality** would therefore, give us Lhc must information, 
and “appearance and manner’’ the least iniormalion about this 
whole group of trnils- 

b. By the Instructor, Using the samc^ method as the atudiints, 
the instructor rated the members of the class on each trait of the 
scale tlie results are given in Table No, III. 


TABLE NO, III. 

INS'i’IU'CTOlVS I'OTIMATKS ST\UiKNTW. 

Student Mental Appearance Origin- Lender- Inipersonal Rank 


No. 

Alei'tness and Mnnnev 

ality 

sh ip 

Reasoning 


1 

27 

7 

28 

21 

27 

24 

2 

13 

16 

17 

16 

14 

14 

o 

7 

17 

21 

11 

9 

11 

4 

29 

24 

23 

20 

19 

27 

5 

S 

9 

15 

14 

13 

9 

C 

12 

4 

10 

13 

12 

7 

7 

23 

28 

29 

25 

25 

30 

8 

1 

1 

7 

2 

1 


9 

21 

IS 

24 

17 

20 

22 

10 

9 

11 

3 

12 

10 

6 

11 

a 

Ca 

2 

G 

11 

3 

12 

10 

8 

12 

3 

5 

4 

13 

IG 

10 

14 

5 

17 

10 

14 

14 

22 

20 

e 

21 

IG 

15 

24 

12 

25 

28 

22 

25 

IG 

G 

5 

1 

1 

G 

2 

17 

17 

ID 

16 

15 

28 

20 

18 

28 

8 

30 

26 

29 

28 

19 

4 

14 

5 

10 

7 

5 

20 

15 

20 

26 

18 

8 

17 

21 

20 

13 

22 

23 

18 

21 

22 

22 

15 

27 

24 

26 

2G 

23 

25 

25 

19 

4 

15 

18 

24 

18 

23 

4 

■27 

30 

23 

25 

5 

26 

9 

22 

4 

12 

26 

11 

30 

18 

29 

3 

19 

27 

2 

21 

8 

19 

2 

8 

28 

19 

27 

13 

7 

16 

15 

29 

30 

29 

11 

30 

23 

29 

30 

2G 

2 

6 

9 

24 

13 
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Observations made from Table No. I also apply here. When 
the rating of a student in one table is compared ^vith that 
student's rating in the other, this observation is made. Only six 
students are rated the same on any one trait in both tables. Of 
these, four are on leadership. They are N 05 . 11, 17, and 26. 

This agreement, though slight as it seems, selects the highest- 
ranked leader and almost the lowest* 

The intercorrelationa of the traits as presented by the in¬ 
structor's estimates are shown in Table No. IV. 

TABLE NO. IV, 

JNTKKCOKUKLATIONS TRAITS. 



a 


5 - 




S' « 



c! c; 


Mental 

Alertne 

2 S 

d 

g 

'& 

X 

0 

w 

S 

■nJ 

.3 

0 

w 

M 0 

S? ^ 

ft pl 

HH W 

Mental Alertness 

...... 

.20 

,85 

.49 

.80 

Appearance and Manner 

.29 


.26 

.48 

.14 

Originality 

.86 

,25 


.70 

.45 

Leadership 

,49 

.48 

.70 


.43 

Impersonal Reasoning 

.80 

.14 

.45 

,43 


Total 

*61 

.29 

.56 

.51 

.46 


"Mental Alertness” shows the highest intercorrclation of all 
the traits with "originality,” the students’ moat significant trait, 
talcing second place. “Appearance and manner” continues to bo 
the lease significant of all the traits. 

CORRELATION OP STUDENTS’ ESTIMATES OP INTELLI¬ 
GENCE WITH STANDARD SCALES. 

In order to test the value of students’ estimates of the intelli¬ 
gence of fellow students by means of those traits, we have 
brought together in Table V the results of Tables I and III and 
the students’ ranking in both college grades and the Otis In- 
telligence Teat. 

In column No. 1 the students are ranked by the class on the 
basis of the six traits in Table I. Column No. 2 contains the 
ranking of the same students by the instructor on the basis of 
these same six traits. In column No. 9 the students are ranked 
according to their gi'adea in the oflice of the University. The 
ranking of the students on the Otis Group Intelligence tests is 
presented in column No. 4. Their scores were made on the 
"Advanced Examination: Form A. Edition 1921." 

The instructor's estimate and college grades are combined 
for the ranking given in column No. 6. This is done to get a 
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IGo 

comparison of tiiis combined rating with Ibe results on the Otia 
Test. Before ntfcempting to compare the estiinntc made by the 
students to any of tliesa standards, I think it 'wise first to de¬ 
termine the value of the instructor's estimate, tlie college grfides, 
and the Otis Intelligence tests in relation to each other. Since 
the Otis test is generally accepted as a standard measure of in- 
telligeiice, I will evaluate the others in tci’ins of it. By compar¬ 
ing column 2 with cohimn 4, one secures a correlation of .46, 
between the instructor's osUmate and the Otis Teat. In the 
same way the relation between college grades and the results on 
the Otis test is found by comparing columns 3 and 4. This 
correlation is .63. By a comparison of the rankings in col Limns 
2 and 3 the correlation between instructor’s estimate and college 
grades is found lo be .41, The instructor's estimate and college 
grades arc often combined in Judging intelligence. Their conv 
bin eel value when compared with the Otis test is found by com¬ 
paring columns 4 and 5. The correlation is .57. When combined 
in this way they give a higher correlation with the Otis test 
than cither one when taken alone, These correlations nve 
^‘markedly present/' yet not too high. However, since both in¬ 
structor's estimate and college grades are in such common use 
I nin using them ns standards along with the Otis Intelligence 
Test. 

Tliege three standards are significant because of the fact that 
they are of different types. The Otis Test is a theoretical attempt 
to build a scale of mcasureinent. Its further value lies in the 
fact that its scores check favortvhly with scores made on other teats 
which are equally sound in theory. The instructor's estimate is 
an entirely different kind of standard, tt is an individual judg¬ 
ment, while the students' estimates form a composite judgment. 
Theoretically this lust should be the proper basis for judging, for 
after all this is the final criterion in the business world. It is the 
composite judgment of one's fellows that places one at a particu¬ 
lar level, Hollingworth finds that group judgment is more ac¬ 
curate than the judgment of the individual. "The individual 
judges intelligence with a correctness of only .19 on the average; 
the group judges intelligence with an average correctness of .61." ^ 
rt. Instructor's estimate. By a comparison of columns 1 and 2 
of Table V one is able to determine the relationship between the 
students' estimate of intelligence and that of the instructor. This 
relation, expressed by menna of correlation is .01. This is a 
rather high correlation and would seem to justify the conclusion 
that the summation of the opinion of students with the maturity 
and college rank of this class is as good a measure of intelligence 
as their instructor's judgment. 
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TABLE NO. V. 

KK'l'IAIArKS AA’D KTANDAUn fiCALKR. 

Inst. 

Estimate 

and 


Student 

StudonLs’ 

Instructor's 

College 

Otis 

College 

Nuriiher 

Estimates 

Estimates 

Grades 

Tests 

Grades 

1 

28 

24 

22 

20 

26 

2 

15 

14 

30 

14 

25 

3 

20 

11 

8 

10 

7 

4 

10 

28 

9 

4 

17 

T) 

25 

9 

7 

27 

5 

0 

9 , 

7 

10 

12 

11 

7 

8 

30 

27 

24 

30 

8 

12 

1 

3 

1 

1 

9 

11 

22 

25 

29 

27 

It) 

5 

0 

15 

17 

9 

11 

1 

3 

1 

2 

2 

12 

3 

4 

5 

10 

3 

13 

13 

10 

17 

23 

13 

14 

10 

10 

20 

18 

23 

15 

27 

25 

28 

30 

29 

Id 

4 

2 

29 

G 

Id 

17 

21 

20 

18 

21 

20 

18 

20 

28 

13 

22 

21 

10 

7 

5 

4 

3 

4 

20 

30 

17 

20 

28 

18 

21 

19 

21 

21 

19 

22 

22 

29 

26 

24 

26 

28 

23 

22 

18 

19 

15. 

19 

24 

23 

23 

10 

8 

15 

25 

14 

12 

0 

13 

G 

26 

17 

19 

2 

7 

10 

27 

G 

8 

11 

5 

8 

28 

2 

15 

12 

25 

12 

29 

18 

29 

14 

9 

24 

30 

24 

13 

23 

11 

16 


b. College grades. When the rating* of the ineinbers of the class 
made by the students and found in column 1 is compai-ed with the 
results based on college grades and given in column 3, the correla^ 
tion ia found to be '.34.. Thia is in keeping’ with the student judg¬ 
ment, for when building their scale they placed collegre grades as 
the poorest of the six traits for measarlng intellie'ence. One 
must not confuse the student’s ability to make college grades with 
what he actually does- These students are ranked on the grades 
uToThiuh+Av^rMi ■ i7m?/yfn// //loiirht OVJrtracrcT^tiigt: jl' .ShiiTl.rr AfuJIntfsi arc 

rop(; ril’d In nllier dm piers of Mil.s ti>ok. 
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tliGy have actually mndc. We cannot sny how nearly they ap- 
in’oncli tlio best of their several n bill tic a. 

cj. Otis Intelligence Tcatfi. As ii final mcaaiirc of the sLiulonts' 
Gstiumles of in Lei licence the students nre ranked aceorflin^? to 
their sneceaa in the Otis Intelligence Tests- The range of their 
scores on this test was from 126 to 203. The corvolntion of the 
two rimkiugs thus given in columns 1 mid 4 in Tabic V is .hi. 
Stud cuts ostiniates of intelligence comp arc very fuvurably with 
tho rGRiills of the Otis Test, slig'htly betterp in fact, than other 
vestigators have found college grades Lo relate to intelligence. 
Pressey obtained a correlation of .'18 between i nielli gene u and 
school marks/' Term an found a correhiticm of .46 between schnol 
innrkc and mental age/ Book reports the coelRcieiit of correlation 
for high school seniors betweien school marks and intelligence to be 
,47/ If, therefore, we take the Otis Intelligence Tost ns a ntnn- 
dard the consensus of student opinion miiKb be highly rorpooled 
as a nieasurs of inlelligeiice, 

SUMMARY. 


1. Cov rel a tiou Summ ary; 
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O 

6 .5 


.G1 

,34 

.61 

.48 

I us L rue tor’s Estimates 

,G1 

. 

.41 

.46 

.82 

Gollegc Grades 

.34 

.41 


.63 

.83 

Otis Tests 

.61 

.46 

.63 


.67 

Col, Grades and Inst, Est. 

.48 

.82 

.83 

,57 

. 

Average 

.4^) 

,50 

.62 

.52 

.07 


2. If the instructor's estimate is an accepted standnrdp the 
consensus of student opinion, g’ained under the conditions of our 
experiment, is a better measure of intelligence than college grades 
or the Otis Tests. 

3. If the college grades are taken as the accepted standard the 
students' estimates arc not so good a measure of intelligence as 
either Lhc instructors' estimates or the Otis Tests. 

4. Accepting the Otis Te.'its as a standard, the stiideiiLs' esti- 
■niates are practically as good a measure as either the ins Lr us tors' 
estimates or the college grades. If, however, the instrucLora' es¬ 
timates and college grades arc combined, they give n slightly 
better measure. 

i Tftc y of the fffoup Point Sralo io Prof/nuntU u tin*/ 

joiff Pitlini'cs fji .funior JHtjU ischuot. Jour, of AiJplh'cl J’sycliuloj^i^ 

'Toniuni, L. >1.: The InietUfjcncc of {School GhiUIrviij lOlf), iiiigp 71). 

’Uook, W. Ri The In !cUi(fCuvc of Ilif/h School Scnioiaj 11)22, pugr 10.1. 





A SCHEME FOR COMBINING INCOMPLETE 
RANKINGS 


By J3. r. Haugiit 

The Stntc University of New Mexico 


School marks are usually assipiied to several groups of stuclenlB 
ill terms of letters. The number of groups ranges from three to 
seven- When these marks are to bo combined in such a way to get 
the student's average standing, the task is found perplexing and 
often ainbigiious. So]neiimc>s percentngo values are assigned to 
each letter and these values averaged. In other eases point vah 
use as 5, 4, 3, 2, 1 and 0 are assigned to the letters A, B, C, D, E, 
and F respecLively and the average found. Both of Dicso methods 
often give very unsatisfactory results- The principal cause for 
this Is the valuation in the absolute mark a assigned by difTerenl 
instructors. In some classes where there is no reason to infer 
that the selection has been great, a large per cent of the class 
receives high grades and at the same time in other classes the 
low g’l'tides are more mini Grows. In order that the work for the 
semester or term may bo averaged in a satisfactory manner, it is 
desirable to find some scheme that will partially eliminate ibis 
wide variation in teachers’ judgments- 
Teachers agree much more closely in ranking a group of stu¬ 
dents or a bunch of examination papers than they do in assigning 
absolute grades in terms of letters or percentages. Usually there 
is no di/Ticulty in ranking the best and the poorest fourth of the 
class. It is not usually diflicult to rank a class of thirty with con- 
sidevablc accuracy, The smaller the class the easier the task 
unless the proces-g of selection has been very great. Even then, 
if vigorous work is required and the tests are made difficult 
enough, individual differences are revealed, 

That instructors do vary greatly in their marlcs does not need 
further proof to those who have had experience with teachers’ 
grades. That rankings made by difforenb teachers are less vari¬ 
able and consequently much more reliable may not be accepted so 
readily. Meyer published the distribution of marks assigned by 
forty professors at the University of Missouri to their students 
in a period of five years. These distributions show that the per 
cent of A’s assigned ranges from 1 to 55- Similar tabulations 
have been published for Harvard University, University of Wis¬ 
consin, and Cornell University \ All these tabulations furnish 
evidence of the wide variation in marking. Starch presents fuv- 

‘StiU'cli, Duukl: Ut} i?«/ imi nT Pm-hoTn^-; IM, 
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ther evidence to slio'w tlint the variation !imoii^>‘ teachers in mark¬ 
ing the same pai^er is jnst as grcnil. When school worlc in two 
subjects like arithmetic niul langiuigo, however, is correlated, a 
marked or high corral a tioii is usually obtained This is evidence 
LhaV, aUhough the teachers have varied greatly in the Kiiccific 
marks assigned, they have not varied so niucli in the order of 
raiilciiig, 

If we admit that ranks are more accurale than the traditional 
school marks, are \vc any nearer the solution of our proldom? 
How are we to combine these ranks? No instructor will rank all 
the stnclciits in any one class. How shall we weight a rank of 1 
ill a class of 5 and the same rank in a class of Jlo? Certainly 
they should not have equnl weight. 

The first investigation that attempted to solve this problem, as 
far as the writer knows, was by ProfoFSsor E. L. Thorndike 
Uccently other investigations have appeared. Important among 
these is the one by M. J. Roam Roam's inetiind is only a niocli- 
ficabion of the one set forth oar liar by Thonulikc, hut cortainly 
is better in being more accuriilc ami le.ss laborious. The .scheme 
here prasented is only a modification of that siiggosLed by Ream. 
It is better for two reasons. First, it eliminates negative signs 
and decimal fraction a, both of which are likely to cause errors, to 
say nothing of the extra time and care. Second, the units are 
expressed in percentiles instead of in standard deviations. The for- 
mar hna more moaning to the aver ago parson. It is, of con vs a, 
true that they amount to the fiamo thing*. 

It is assumed that all distvibiiLion.s arc normal and that any 
skewnass is due to the teacher's iiuiccuracy in grading or niark- 
ing. This assumption is not ubsoLutely true, hut it in much U’uov 
than to assume tho distributions ohlaincd from the icacliars' 
grades correct, In the writer’.s opinion, to throw a distribution 
into percentiles and thus give it the form of the normal frequency 
curve corrects many errors of judgmemt on the part of the 
teacher. It will have to be uclmilLcd, however, that it introducas 
sonic errors as well as retains some of those already there. Thi.s 
is especially true when the gruiip being consider eel is highly 
selected. 

A concrete example of how the percentiles are found for a 
class of six will make the procedure clear. Pir.st, the ii uni bars 1, 
2, and S are divitlGd by b, the mimber in the chiKS. Thi.s gives 17, 

DaiiliU: jjth fifnuy: lirja, Ti\-r,7 

^'riioi*BUllki‘, 10. T/.: 77/ri ftf /nt ouffiU'fr Jufffnnrn fi( 

na* nwHiUijii f,/j !i j'lip’i.'i iiiirk i,/; j) .iti-na.s, ,>uurn!ii (O' lUiUii.^uriiy, 

Us.vclltilngy iiiul SolriuUlf McMioils 10111, 1.‘5, lOT-llOJ. 

^ .S[. ,1.: .1 siuHsfival J/i Pirjf/ fur Oulrr tit Mail litii- 

wir't. Till! Jfiui'iml f)L AiJiiUril L'syclujlot^v, .1, 



COMBINING INCOMPLETE RANKINGS 170 

3ii and 50. Second, from Thorndilse's Mental and Social Measure¬ 
ments, Table 54, the nuinbera correaponding to 17, 33 and 60 are 
1A9, .68 and .22 respectively. Third, 3 is added to each of these 
numbers to give the cliataiicc in terms of the standard deviation 
from the lower end of the distribution instead of from the middle. 
Fourth, ench of the three sums is divided by 5, the length of the 
distribution in tor in 3 of the standard deviation. The quotients, 
76, G1 and 64 are the percentiles. The scores for the lower half 
of the group may be found by inspection since the distribution is 
assumed to be symmetrical. 

Metliod of application. Now suppose we wish to find the aver¬ 
age score of an individual. Let us take an actual case, that of 
student X. He ranks 

1 in n class of 6 

1 in £i class of 42 

2 in a class of 18 

2 in a class of 22 

13 in a class of 40 

by consulting- 11 m tables, wc find the corresponding percentiles to- 
be 75, 91, 73, 76, and 58 respectively. The average of these is 
74,4. In a like manner the averag-e may be found for all other 
students. 

At the University of New Hcxico, each instructor is requested 
ro ranlc the upper half of his classes and include these ran kings 
in his final acme a Lev report. For the semester ending January 28, 
1922, the writer aslccd each iTistructor to rank the lower as well 
as the upper half of the class. Two exceptions were made, The 
instructor of history was not able to havg charge of his classes the 
last month. They were taught by .substitutes and for this reason 
are not included. The other exception was music, which probably 
depends more upon special ability than upon general inlelligencG. 

After all the data were assembled, the average for each student 
was found in a manner similar to that used in the illustration 
above. All subjects that woro not ranked as many as tliree times 
were discarded. No attempt was made to separate the college 
classes. If freshmen and seniors happened to be in the same 
class, they were ranked without respect to cla.ssification. No dis¬ 
tinction was made for classes meeting two, three, four, or five 
times a week. This could have been done, hut seems foreign to 
the problem. 
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During- the semester the ^vritcr gave the Alpha tests to 148 
students in the University. A few of these dropped out before the 
end of the semester. AUogoLher there 'were 138 ^vho had scores in 
scholastic achievement and in the Alpha tests. The 138 students 
were assigned percentile ranks in each trait. Tho.sc wore assigned 
in sucli a way as to ninke the disiribuLion take the form oC the 
normal probability curve. 

As a cliGck on this method of finding scholastic scores, the fol¬ 
lowing values were assigned to tlie several letters and the sLu- 
denb's average grade found; 

A=J)4% 

E=r>7% 

C=r81% F=509^ 

After these averages were found, the 138 students were assigned 
percentiles so as to p;ive the distribution the fovin o£ Lho norinal 
probability curve, Three correlations (by Ibc product-moment 
method) were now obtained: first, between intGlligciico.teats and 
the scliolastic standing deLcrinincd wliolly from the ranks; second, 
between the intelligence tests and the .scholastic standing deter¬ 
mined by assiging absolute values to the letters indicating the 
grades; and third, between the scholastic standings doLermined by 
the two methods indicated above. The three, correlations are ve- 
pectively, as follows; 

r 

1 - .JO 


r 



The nietliocl of disregarding absolute grades and using only the 
ranks, then, gives a more reliable result judged from the intelli¬ 
gence tests as a criterion. The difference hetwCGn lho two methods 
is small, yet it is sufficient to be significant when this mimbei' of 
subjects is used. The two scholastic rankings have a higii corre¬ 
lation, yet it is far from perfect. 

Great scientific accuracy is not claimed for the schcino here 
set forth. It is as accurate as any now in use and hag the ad¬ 
vantage of being very simple and easy to manipulate. The 
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smaller the class the less reliable arc the results. In classes as 
small as four or five no great injustice seems to be done to any 
one unless all the member a are very good or very poor, which is 
not likely to happen. 


a 



3USd9 



999!;9 

99999 



Slaws'* 

9 

eW5Pf{ 


30Ia37I 

Tiunasi 

aauas\ 


99993 

7nnifnf) 


jfiMa- ' 

9 


?auas 

QU39?l 


3a5S9 


79933 

ftaunj« 

HASSA 

R)S" } * 


sisir-i^u 

PSKtSS 

'juism 

^•KS«a 



99933 


NRrluri 

RA 1 

i 

sumi 

pstaa 

Oe3^5J 


cias99 

V4yi?5 

9933R 



« , 1, 

•a 

sufir-t. 


Li:;sa^ 


cisa;>3 

!;3973 

M=3R?? 


n>2fj2“' 

f / ' V 

- 

S'iKrrr: 


usasc; 



tsi^ay 


IRiiCnSR 

sas’* 

i . M 

Q 

sHsr-r 




S5!99P 

isgiyg 

3gsp» 

jsnzfif. 

iia^'» ' 

1 M M 

a 


sibsaa 

SSS5K 

Si3:TJ?C/ 


!?y?y3 


ernsins 

' . i 

f ' ■ ' 

? 



(SSStlnU 





sasiaa 

>* '. 1 

1 1 . • 1 

S 

s?~\2un 


55J2S!L^ 

naay;? 

v'?%aa 


PPi?aH 

anms 

.Ml) 

' ' ' ' 


sr.fc/iP 



saasfSi 




fitifia 

■ . 

1 M 1 i 


i/stn^a 

atisQs 

S8)S!n» 

aaa:;% 


oy^nu 

^lawaTi 

mi Si 

1 1 1 1 ' 

1 1 ' 


2.-5f:;J3 

^:93^^s 



55537J? 



«a i ; ; 


1 ! M 


sRrrs 

uaztis 


aM55^ 

csiga^j 


nAru^n 

u 

' • 1 

1 1 M 


2r-nr:a 

UQBLI3 

ssi^s:i 


sssggs 


S?1KH J 

i ' 

' 1 , 

1 M ' 


SfClM-ttS 



M5J5 ?i? 

a^!3^5 


nsfra ■ 

' ( ' 

' . 

1 



S kSQSS 

auaaa 


sjrjsR 


f,m. 

1 


' 1 

9 


•i 



5 fl 

sag?)?i 

fin 1 

M ■ r 

/ ' ■ 

r . 



^saaii 





H ' . 

1 

Mil 

1 1 

R 

aspRa 



:»?rSV)?j 



' 1 . 


■ ■ 

i , 

n 

g?!r-'st 

i3sr??.? 




amu 

; 1 



' 

s 



asHs^ 


^8?wnw 

ftUS , 

1 1 

’ : ' 


1 

K 



tavinsi 

I;93ys? 


AS . . ' 

Mi , 

. ' 

- 1 1 

' l 

fi 

aspssi 

3sai;a 

2Iu|tn$ « 



r 1 u 

I ^ > 




a 



Kt!R^?W 



1 


, M ' 

k 

. ' 1 

rt 



ssv-ia 


, 

■ ! ' ' 

J M . 


’ , ‘ ' 

, k 

a 

isurus 

Lisss::; 

aS?i!3 


fins 1 ! 

111 r 

1 ^ 1 

1 ' 

' ‘ f 

1 ( ' 

n 



ssi;s5y 


ns ' ' 

, L ., 

1 I . 

' 


1 1 

n 

s??ssa 

53S35J 


Rpasn 

S f ' ' 

■ . , 



.’ , 

' 


ansisu 

aaastr* 

2H;v5'.i? 


‘ 1 

'' ', 

' , 

‘ ' 

, , ’ 1 

' .: 

? 



9!93??0 

! 

i 1 11 1 

, 

, . M 


' 1 

' 

2 



^ZPSfiA 

WflS ' 

■ . 

' . J 1 

■ 1 

. 


M . ' 

S 


afflas‘>; 


UP 11 1 

11 1 

1 '.' 

1 

' 1 

' 



SPL-Q9 



P f ! 1 ' 

! ' 

i, (). 

ill. 

' ' : 

’ ; 




sas';;^ 

snaps 

r. 11 1 

. ' , 

1 M M 


' 


' 

3 

Eir.Sl^iS 

a^iayy 

1 

ill’. 

1 i u ; 

: ' ’ 

1 i 

1 i 

. ' ' 

' ' 

B 

ssasi: 


asis r j 


) ; M 

r , f K 

. W r 


M . ■ 

1 , ' 

£i 



SS 1 

i 1 M 1 

1 11 

, ' ‘ 

'Ml 


, , , ’ 

' ' 

= 



fl 1 n ) 

: ' i r J 

J 1 . ' 

. J < 


k i 

MW, 

M ' M 

g 

pc;i;e;£( 


, 1 ■ i f 

M n 1 

Mill 

((Ml 

’ k ' 

. ' 

M j { 

. ■ ' ’ 


P3SHS 

^3 “ ?! r» 

■ k' 1 

, ' 1 ‘ 

1 l 1 U 

; 1. ''I 

. 

, 

1 1 

Mill 


saaas 

. 

M H r 

U . M 

M 1 M 

1 M 1 J 

1 i , 

' ! , 

' - 

M 1 M 

«- 

taaa^ 

1 i 

1 1 . M 

n 1 11 

\ i '1 

M ! U 

i i 1 

k , * , 

■ Ml 

( ' r i 


tutsan 

» < > j j 

1 J ' 1 1 

11 , 11 

'.Ml 

Will 

1 1 . . 

' 1 . 

1 1 

■ ' 

•VI 


M ,' M 

UK' 

I K 1 

, ' ■ . 

W . ' , 

' I .' 1 


. > 1 

, 1 

•* 

Pt^!3Fl ] 

! 1 1 1 1 

1 1 > . 1 

i 1 1 1 1 

1 . 1 1 1 

' r 1 s 

W 1 M 

. ' M 

I'M 

' 1 , 

- 

SSiS , J 

'; 1!! 

] ) M ] 

J J J J ) 

' i M 1 

i 11 ] 1 

W 1 M 

l 1 ' 1 1 

’ W ’ ' 

‘ ’ 



iDt-KiOte 


S£:S3j3 

ANpaa 

lauRRlS 

RSina:? 



g a 


Showing percentile scores as determined by the number in the class and the rank in that class. 
Numbers at the top of each column indicate the number in the class and numbers in the colvunn at 
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THE BASIS OF TOOTH PASTE SALES IN REPRE^ 
SENTATIVE COMMUNITIES 


By Donald A, Laird. 

I. INTRODUCTION 

This is a report of a fairly extensive aurvoy which was inude* 
of two diatinct conimunitiea with reference to the use and the 
sales of tooth pastes and similar preparations. The survey was 
made by a class in the psychology of ndverbising ns a term pro¬ 
ject. It was conducted in Laramie, Wyoming, a town of about 
seven thousand inhabitants. The population is composed in the 
main of retired ranchers, business and professional families, and 
the families of workers in the refinery, plaster mills, Union Pa- 
cihe division employees, and a scattering of students. 

It was not attempted to cover the entire town. Rather the aim 
was to select as rigorously a a possible certain sections which 
represented unequivocally sociological extremes typical of the 
Main Street town. One section of the town was chosen for study 
because it represented the elite, contained the residences of the 
better classes, business and professional men, university families, 
and a scattering of well to do ranchers who manage their land af¬ 
fairs from the town. This section was purposely kept small in 
order to be certain that the families who contributed information 
for this group were w'itliout doubt properly labelled. In a small 
town there is little difllculty in so classifying the townspeople. 

Opposed to this section, the c?‘e??ie de Id cveme of Laramie, a 
section was mapped out which contained the colored section of 
the population, a majority of the foreign element, and the un¬ 
skilled workers in general. This section is commonly referred to- 
as the West Side, In this report the two groups will be designat¬ 
ed the Elite and the West Side, 

II, THE SURVEY. 

A house to house canvas was made of the two carefully selected 
districts, For each house information was gathered under the 
following beads: 

1. Street and number 

2. Persons in family (excluding roomers) 

3. Br^nd of paste used 

4. Why used (havor, dentist's advice, samples, advertising,, 
friends,'etc,) 

5. How many tubes usiid 'a month 

6. How many in family use paste once daily 
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7. Any othor brands used in family 

8. Why others are used 

7'he canvasers were instructed to pass by any liomes which seemed 
by outward appearances not to properly belong in the district 
being surveyed. 

The students were divided into two equal groups, one for each 
section. A student was selected from out of each group to serve 
as section captain in talcing charge of the details of the survey. ’ 
Several students not in the class requested an opportunity to take 
part in the data gathering. The only canvaacr to be thrown out 
of a house was one of these volunteer solicitors who was ejected 
bodily, even though the do or'in at read “Welcome!” 

in. RESULTS.^ 

A total of 228 families were interviewed, 104 of which were 
from the Elite district. This report is based, however, upon only 
148 fainilics. Some were eliminated due to grossly incomplete 
data, some others were also eliminated from the Elite returns 
because of bad ratings in the local credit bureau. Eighty-one of 
the families to be reported were from the West Side. 

Table I gives the distribution of the families arranged by num¬ 
ber in Iho family. 

TABLE L 

JIISTHHIUTJOX OV rUMIJ.Y I.\ TWO DISTRICTS 


Number in family 

Frequency 

Elite West Side 

1 

0 

1 

2 

18 

19 

2 

18 

IG 

4 

12 

14 

6 

14 

14 

6 

1 

9 

7 

2 

3 

8 

1 

8 

9 

1 

0 

10 

0 

1 

11 

0 

1 


The medium size with the Elite group falls in the 3 interval, 
with the other group the medium falls in the 4 interval- The 
ai'ithmetical moan for the Elite family size is 3.6, on the West 
Side it is 4.1. 

In 67 families in the Elite section there are 64 that make use 

captiiinH wuiv Air. Roliort .ruhii«on ;iad iVt*. llariT I^ngRtiout. 

=Tabiilnioil wlUi tlK‘ aHSlsLimcu uE Mr. Rnliili Holtsnni unU Mr. WJUiivcl 
lirokuw. 
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of a toothpaste, at least one member of the family uses it. In the 
other section there are B3 families out of the 81 in which ah least 
one member uses tooth paate. On a per cent basis this is 80.6 per 
cent of the Elite families and C5.4 of the West Side families in 
which tooth paste ia used. 

It was difficult for many of those interviewed to conscientiously 
state, in reply to item B, how many tubes were used ci month in 
the family. In the Elite section there were only 20 families in 
which this reply was recorded. In the other district 4o families 
replied. These families represent 77 individuals in the Elite dis™ 
trict and 194 individuals from the West Side. The twenty fam¬ 
ilies from the Elite group report the use of 37 tubes (full size) 
a month. This is an average consumption of 0.48 tube u month 
per individual. It must be borne in mind that this is per individ¬ 
ual for whom we have data available. If tliis included all the 
families it is quite probable that there would be a zero after the 
decimal point. The West Side families reported the consumption 
of 84 1-3 tubes per month. On an individual basis this is 0.43 
tube per individual per month among those who reported. 

These results are somewhat in contrast. Among all the famil¬ 
ies interviewed we have found th«at a considerably larger per 
cent from the Elite district use a dentrifice., But when this com¬ 
parison is reduced to a comparison of amount used by those that 
do use a dentrifice then the two groups practically coincide. 

Of most interest from the point of view of advertising ia why 
the users use the particular brand that they do, Admittedly in 
many instances the replies to item' 4 were rather forced, for they 
had never given the matter much consideration. RatioTializations 
in forced explanations were undoubtedly very conspicuous. But 
at that the reasons attributed by the users for their use are a 
revelation, Especially when checked up with the chief overt ad¬ 
vertising appeals that are in vogue in the marketing of these 
prep arations. 

Table II gives a detailed tabulation of the responses to item 4, 
It should perhaps be noted in passing that before the solicitors 
went out into the fteld they were gathered together and instructed 
regarding the data to be collected. They were especially warned 
against suggesting any response other than what might be tho 
natural one. In the case of item 4 the suggestions in parentheses 
were arrived at after the group making the survey had tabulated 
their own reasons for using their particular brand of dentrifice. 
In case it was necessary to give suggestions to the person being 
being interviewed they were instructed to read the entire list of 
suggestions before letting the subject respond. 



176 


BASIS OF TOOTH PASTE SALES 
TABLE II. 

IlEASONft GIVliJN X^OIi I'lIK USK OP DlilNTRIPICP, I3y liRAND AND 

SKCnoN 
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Totals 


13 

20 

1 

4 

2 , 

13 

1 


21 

17 

7 

1 

1 

3 

3 


A coTiiparison of the totals columns sliows the dilference between 
the two coinmunities in the matter of paste used. The pveponcler- 
ence of Pepsodenl and Pebeco in the Elite section is worth men¬ 
tioning in passing. There are other interesting but minor differ¬ 
ences in the choice of a dentrifice between the two groups. 

When the reasons given for the use of the particular brand are 
examined group differences also appear. The largest difference 
under this head is in the advice of the dentists. This appeared 
13 times in the Elite section, and 1 time in the other section, 
Samples, which had been given the children in school^ was given 
aa the reason for the start of the use of a particular brand ini 
three homes of the West Side, and not once in the other section. 
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The predominant rexison for the use of pcrHonal brands was 
tlint of the flavor of the preparation. No^^’lccLiiiff tho no reason 
responses this reason of the flavor beiup; liked has a greater fre¬ 
quency than nil of the others combined. The ratio of 47:2£) 
between the use oi Colgatca and PepsodenL can largely be ex¬ 
plained on the basis of flavor. Even in the Elite .section where 
one would expect to fnid the consiiiners influenced by scientific up- 
pcala in advertising wc still find flavor predoiniiuUing over dentul 
advice and ndvertising in the reasons given from Ibis group. 
Undoubtedly the manufacturers nro well awaro of the impor¬ 
tance of flavor in a dontriflee. Their adverti.sing, however, almost 
without exception is directed toward certain scientific soinuliiig 
appeals for the use of their product. When one gets down to the 
reasons given for the use of any particular brand, the acicutific 
reason is not mentioned n single time. Undoubtedly it is the ad¬ 
vertising, based upon the opinions of high dental auUiovities, that 
has established the rigorous tooth paste habit of Mr. Average Citi- 
aon^ whether he lives on the \Yest Side or on Easiy Street. Flavor 
on the other hand, seems to be the principle determining reason 
for the use of any particular brand. 

IV. SUMMARY. 

A house to house survey was made of the two distinct districts 
by the students in a class in the psychology of advertising. A 
good and poor residential district was covered. The tooth paste 
habits of the inhabitants was CTiquircd into. It was found: 

1. This is an excellent method of instilling the spirit of scien¬ 
tific psychological approach to the problems of advertising; 

2. About 80 per cent of the families from the better section 
and C6 per cent from the poorer section make some regular use 
of a dentrifice; 

3. On the basis of individiuil consumption, there is no signifl- 
caut difference between the sections among those Uutt do -nsc a 
dentrifice. In other words, when the tooth paste habit oiicg hits, 
it hits with equal force in both districts; 

4. But, the tooth paste habit does not occur with as great fre¬ 
quency in the poorer district as in the better class district; 

5. Dentist's advice plays but a very minor role in the use of 
dentrifices in the poorer districts; 

G. In both districts the predominating reason for the use of 
any particuki}' 6ra?id ig determined largely by the flavor; 

7. School samples play no apparent part in the use of a 
paste in the better districts, they do play some part in the poorer 
district. 



VOCATIONAL TESTS FOR AGRICULTURAL 
ENGINEERS 


By II. K. Buut aki> F. W, Ives 
Ohio SlaLe University 

INTRODUCTION 

Tlie is n eniitrilniLioii to Llio dcvelopmont of vocation- 

b 1 norms which are c.s'sentiul for scientific vocational guidance and 
sclecbion. It presents nolhinjj* pnrliciilarly novel in the way of 
tcchjn[jue but R-ivos dfiLn for a vocation that has not hitherto been 
studied in thin nuinner. 

It is obvious in the university as well as subaeriuGntly that some 
men who undei’take ap;ricultnral enRincGriiiR sis a vocation lack 
the requi^iite nlnlity. lienee the probleni of vocational in'cdiction 
is ill point. IMoreovor this vocation requirGS more than mere in- 
fcelligence. Observation and analysis makes it clear that it is to 
quite an extent a question of .special ability- So an cfFort was 
made to devise special ineiitnl te.yLs for predicting this ability and 
lo standardize them on advanced students in agricultural engin¬ 
eering. 

METHOD 

The selection of the tests was based on some preliminary experi¬ 
ments tho in’GvJous year as well as upon further analysis of the 
mental factors involved in the vocation. Typical of such factors 
are motor coordination involved in the use of surveying and draw¬ 
ing instruments, various aspects of attention involved in testing 
farm machinery and taking readings at the proper moment, spa¬ 
tial perception and iinfiginalion involved in planning farm build¬ 
ings with reference lo their contentsj and observation and judg¬ 
ment involved in planning topographical layout or drains, While 
no mental test measures any such factors exclusively, an effort to 
approach such measuremenfc is far better than random selection 
of test material. Some of the tests employed were modifications 
of those used by various investigators and aomc were devised 
especially for the occasion. Those which proved useful and were 
retained in the final norms will be described below. 

The tests were given, with two exceptions, by means of mimeo¬ 
graphed blanks. All the blanks were clipped together in a folder. 
The group method was used and each test had a time limit such 
that no subject would quite finish it. Each test comprised two in¬ 
stallments,—on successive pages or on the same page separated 
by a space and the word "stop/' according to the amount of ma¬ 
ter ini. At one sitting the first installments of all the tests were 
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given ill succession. The followine* clay the second iii.stallnionts 
^veYe ^''ivcn in the same order. It wu.s thus possible Lo locate cases 
^vhci'G the subject misunderstood or nuido a bad start and aLso (if 
desirable) to correct for aItennation. The order of the tests ^vns 
designed to avoid undue fatigue by interspersing’ tests reiiuiring 
close concentration and effort with those .somewhat loss exacting. 
There were 14 tests used but as several were scored in more than 
one manner, there were 18 different indcpciul(3nt variables involved 
in the research. 

The directions were ftiven orally. The Avst page of tlio folder 
contained examples of various 'tests and after nnisbing one test 
the subject marked the place in the folder with the finger and 
turned back to the example page during the exphinatiou of the 
next. The examples wove in iiio.st ca.se.s designed to alluw one or 
two iteni.s for practice. The directions were, i>f course, standard 
and given vcrbatijn but were alihreviatod somewduit for the second 
installments. 

The subjects were 4,'l advauced sIucIguLs specuiU'/.iiig’ in agricul¬ 
tural engineering at Ohio Slate Uiiiver.sity. Tlicy were tested in 
two groups during the winter of 1921-22. They were directed to 
take the examination by the dean of their colleg’e so it i.s safe co 
assume that incentive was sutHeiently nctvr tv mivxiimim to be con¬ 
stant. Tlic testing was done personally l)y one of the writers 
(Burtt). The total time for the tests, including directions was a 
trifle over two hours, i. e. one hour at each sitting;. 

The ci'itevion for evnkiating the tests con.^^isted of ratings as to 
'^ability in agricultural engineering'^ made by three instructors in 
the department. Ihatings were used rather than grade.s in engin¬ 
eering studies on the theory that the latter arc less apt to rofleet 
a man’s actual ability. 

The ratings were made on a Imcar scale of the sort commonly 
used. The names were,typed in a column at the left of the page 
followed by five rtiled columns of uniform width. Tliese columns 
were headed from left to right “lowest fifth”, “next ]o\ve.st fifth” 
etc., and represented the diatribiition, on the basis of ahillLy, of 
all the persons pursuing this vocation whom the judge new. A 
cross was to be placed after each name indicating the .student's 
ability with reference to this whole distribution and the greater the 
ability the farther to the I'ight the cross was to be placed. A pTO- 
liminary statement at the Lop of the blank explaiuefl this method in 
detail. The ratings were then iiieasured in millimeter.s from the 
left edge of the left . column, thus expressing the. judgment 
quantitatively. 

The instructors made their ratings independently. The raw 
figures could not bo validly averaged for a given subject because 
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■the juflges mi^rhi difT'ev in tln» central tendency and scatter ol tlieir 
ratings, ConsetiueisUy each jiidj?e's estiniates were converted into 
Llie form x dividoii by nUjmn^ i. e. the deviation of the measure in 
question from the mean of that judge's I'uLing.s taken in terms of 
tho standard deviation of his ratings, Witll such converted meas¬ 
ures the three jiulgos' esUmahos for ii given aii\)jocl could then be 
averaged to gc't a conihiiied rating (the criterion). Most of the 
sabjccU were rnLed by all three judges but in the case of three- 
subjects only one rating v/as available, 

The next .step was the dual selection of the tests. The scores 
for the two in»Lailments of each test \vore nddeil together to form 
a single score which was used through out. Correlation scatter 
plots were them made for each tost against tlie criterion. It was 
foun<l convenient to plot several pairs of variablGs siniultanoously, 
keeping the criterion on the ordinate, aligning the blanks, placing 
a long ruler below the desired row and cbeclcing in the proper 
column oil each blank for the other variablc.s. Those plots whicli 
showed by inspection any so in bin nee of correlation were coin pu ted 
by the 'h>i‘odLictS'inomonts’' foriniiia. Eight of these were retained 
as showiiig some i)rojni-so (Lho liighost coe/ficiont being ,47) and 
inter cow elated and the regression equation derived. 

DESCRIPTION OP TESTS 

Only the seven tests which appeared in the hnal regression 
equation will be de.s’cribed. There were eight tests in the equa¬ 
tion but the weighing of one of these proved to be zero. They 
are numbered as they were jji the equation hut these numbers 
have no ulterior .significance. 

Tost 2 cou si steel of n series of small circles (letter on a 
typewriter) in two columns 2^^ inches apart. Those in each col¬ 
umn were double spaced on the typewriter with the right column 
a single space below the left. They were numbered alternately 
in the two columns, i- o. odd numbers in the left and oven nun> 
hers in the right. The subject connected the circles in the nuiiri' 
bored oi*dor, i. e. drew ati’aight lines from side to aide, gradually 
moving down the page. He kept time with a metronome set at 
120, i. e. made a stroke to the right and back again in a second. 
There were 66 circles in the column. The subjects were stopped 
immediately at the moment they should have finished so that if 
they did not keep with the metronome their blank was incomplete. 
There were two series of this sort on a blank. One was done as 
above described but for the second the page was turned 90 
degrees so that the strokes were up and down. One such page 
constituted an installment of the test. The instructions were to 
atop as near as possible to the center of each circle but to keep 
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time with the metvorioiiio. For scoring, u tran spur cut stencil 
was made with a ^4 inch circle concentric with each "o", A.II 
strokes the end of which fell within this circle counted one point. 
This penalised those who did not follow the metronome to the 
extent of one point for each stroke they failed to make. The mnx- 
iinum scoi'e was 224, 

Test 3 had at the top of the page a large diagram of a triangle, 
circle and rectangle overlapping in such a manner tliat there were 
areas comprising all three figures, each comhinnLioii of two of 
them and each alone. In each of these areas wore several ay mho Is, 
—vowels, consonants and digits. The following are typical of items 
which appeared below the diagram; 

1. Vowel that is in triangle but not in circle or rectangle ( ) 

2. Smallest number in circle and rectangle but not in triangle ( ) 

3. Consonant that is in rectangle circle and triangle ( ) 

There were 14 such items in each installment. The instructions 
were to place in the brackets at the end of ench line the letter or 
number called for by the spccihcalioua in that Uue. The time limit 
was 2 ininutus for each installment. The score was the iininber of 
Items correct with a niaximuni score of 28 for the total test. 

Test 4 was Thurstone’s ''Special Relations B” given in one in¬ 
stallment only with a 4 minute time limit. The subject was given 
ample time to read the printed directions attached before turning 
to the test. The score was the mimber of items correct minus 
the number wrong, The maximum score was ?/J. 

Test 5 comprised lines of digits in apparently random order,— 
G5 digits to the line.* The test consisted in crossing out 2 and 
ringing 8 until coming to a 7 and then reversing the process,— 
crossing 3 and ringing 2,—until the next 7 etc. It was ar¬ 
ranged, however, so that the first reaction after a 7 was always 
n "cross out." The subject knew this so if he became 'Tost^' it was 
necessary to go back mei‘ely to the last 7. There were five crucial 
numbers between each pair of 7's and three such units per line. 
One unit comprised three 2*s and two 3’s and the next unit two 
2's and three S's etc. There were six lines in an installment and 
the time limit was 1 minute and 4B seconds. The subject was 
given one point for each correct mark. Furthermore in case sev¬ 
eral items in a unit were marked the opposite of what they should 
be and the subject had manifestly started the unit wrongly and 
reacted thereafter accordingly, he was given credit for the sym- 
, bols thus marked but penalized one point for the initial mistake. 
The maximum total score was 180. 

’A lost Ui nUt4 h;is Uoen wuert \)V II, A. 'i'oopH, hwl ns fur us Iho 

\YrlU‘rs ui'o awnro lins iiol keen luikllaliod. 
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Test 6 was auditory memory by the method of word pairs with 
logical material. There were three types of word pairs nsed; one 
type was normal, another comprised words related to agricultural 
engineering and n third involved pairs dealing with zeal, industry, 
interest in one's work etc. These three types rotated in succes¬ 
sion through the list. The following is typical of a sequence of 
such pairs; 


1 letter 

2 formula 

3 task 

4 diamond 

5 liquid 

6 strive 

7 spider 

8 engine 


St ami) 

eciualion 

eager 

spade 

Ii yd ro meter 

attain 

spin 

windmill 


9 work pleasure 

There wore 27 pnir.s in a series,—9 of each type. Two sucli series 
constituted an insfcailnienl. The instructions were to listen while 
the 27 pairs Avere read and try to notice the natural connection 
between the two words. A metronome, sojuewhal muJllcdi sound¬ 
ed one beat a second us a guide for the experimenter. The two 
words read on two successive beats and there was a pause during 
the third boat. The fir.st word of the next pair came on the 
fourth beat. The subject’s blank consisted of a series of nuni- 
herod lines. ImitJediately aflGr the initial I'cadwg ol the list by 
the experimenter, the first words of each pair were read with the 
appropriate number, e, g. 'T letter, 2 formula" etc. The subject 
wrote after the appropriate numher tho word tljal had paired 
with the one in question. Five seconds were allowed for each 
response. The score waa the number of words correctly recalled. 
Kowever the three types of pairs were evaluated separately. 
Especial interest attached to the total number of Avovds of the 
agu'icultural engineering type recalled as compared Avith the totul 
inimber of normal Avords recalled. The ratio of the former to tho 
latter was the score used in the regression equation. Tlie ratio 
was multiplied by 100 to simplify computation, 

Test 8 was an ‘‘information” test compri.sing items related to 
agricultural engineering. ElTort was made to select items that 
would not actually be discussed in the class room but with which 
an alert interested siudent who read current agricultural engin¬ 
eering literature would be familiar. Technical journals Avere 
used considerably in devising such items. The followiiig are 
typical; 
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1. A ti'flck laying tractor is used for: ROAD ROLLING: 
PAINTING: MILKING: LAYING TRACKS: PLOUGHING* 

2. The best blower belts arc inade of: LEATHER: RUBBER: 
JUTE: SILIC: HEMP. 

3. Soil stack is a term used in: BOILER PITTING: SURVEY¬ 
ING: CEMENT MANUFACTURE: PLUMBING: SOIL 

ANALYSIS, 

Tliere were 20 such itema in each installment. The subject was 
instructed to mulcrline the one of the live altenuilivc.s in capitals 
that belonged in the sentence. The time limit was 2 minutes per 
installineiiL. The score was the mini her of items corrcetly marked 
and the maximum total score was thus *10. 

Test 9 was a modification of Tluirstone’s tlirectioiia Lest. -Parts 
I and II had the following' directions: 

If the word contain.s E, A, and R mark it 1 
If the word contains E Init not A and R irark it 2 
If the word contains A hut not E and li mark it 3 
If the word contains R but not E and A mark it d 
Parts III and IV had the following directions: 

If the word contains I, N and G mark it 1 
If the word contains I and N bnt not G mark it 2 
If the word contains I and G hut not N mark it 3 
If the word contains N and G hut not I mark it 4 
If the word contains I but not N and G mark it 5 
Each part consisted of 40 words of from 5 to 11 letters selected 
so as to belong to one of the classes indicated. They were 
arrang'ed in 6 columns and each word was followed by a sliovt 
dotted line for reeordine: the answer. There were always an equal 
mimber of words requiring each sort of response in the “part". 
The subject was instructed to read the (lireeiions, look at the 
samples and mark the words in the .same way. Parts I and III 
were clone in succcassion with time limits of 2 and 2^4 minute.s 
respectively and constituted the lirst installment. Parts II and 
IV were given likewise as the second installment. The score was 
the numher correct and the maximum score IGO, 

RESULTS 

The regression equation is ns follows: 

X =^.0021X -h.OlOBX +.0091X +.0133X -i-.0128X 
12 3 4 5 6 

+ .0070X —<.0014X —3.1892 
8 -9 

'NVhere XI is the combined vocational score and X2—^X9 the raw 
scores in the various tests above described. The rvoightinp? of 
Test 7 proved to he 7firo. The cocfRcicnt of mi’lltipie corvelaiion 
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Bj (jirfiTSi.) of Lh« wei^^Uod sum of test scores iimX the criterion 
may l>e coinpnfcofl LliooreticnJly fi'oni Ibo partifil Coefficients and 
proven tn he 3]y actiiaUy wei;''htiny the scores a 7 id 

cnrrelntiut^' with the criterion the coefficient is .G2it:.0T. 

The extent to which the v sir ions tests contribute to the finni 
weighterl score may h(» seen from Uie followiiicc la\)le which gives 
for each to si- Llie correlnlii)ii with th<* criterion of zero order, c. g, 
z-,j, mid also of tJ)»; /iovtuiiJ) order with all the other to.^ts constant, 

C. g. riSini:ii:'-Cr, 


Te.st 

7ero order 

Seventh order 

2 

.2-1 

.10 

:i 

M 

.11 

4 

.2(1 


0 

.47 

.I'jij 

() 

,42 

.iio 

7 

.2',) 

.00 

S 

.27 

.05 

1) 

.28 

—.05 


Tcjihi 6 luid h* iipparently carry most of the In ad. They liavc 
the highest coolTicients oC zero order ami also the highest when the 
other tests are constant. Tc:il 7, on the other hand, while being 
fairly good of itself merely du pile ales factors involved in the other 
teats as shown hy the partial ci'enicient of zero. 

The comdation iKatweezi if,sds 5 a fid 0 only .15, A regression 
oqiialioii was dcM'ived using only these two tests and is as follows: 
x,=.oi2nXr.-h.oir)7Xa-2.n4. 

The coeflicieiil of null Li pie corrcLaLion Ri(5G) is theoretically 
.50 and the same resnlL is obtained by weighting the original teat 
scores. Moref)i''er the weighted aiun of /r/^/.v r> azul 6' correlates 
with the weighted sum of 2 —0 to the extent of .92. So it 

i.s obvious that the Lwo tests Avill give almost as reliable a predic¬ 
tion as the seven. 

The technique oC partial corrchition involves, of course, the as- 
sumpLion of linearity of the original regressions. Those regres¬ 
sions were not com pit led to Le.-st this a.ssumption. However for the 
I wo final multiple eorrolatioti.S' of criterion witlz weighted sum of 
tests the corroUition ratio ((^da) was computed. In the case of the 
weigliled sum of the seven cUi for x on y (y being the criterion) 
is .70, while r as above mentioned is .02. Bliikeman's- crilevion of 
linearity (using his simplest formula) is 2,1. Theoretically if this 
is less than 2,5 the regro.s.sion may bo considered linear. In the 
case of the weighted .sum of the two tests tda is .74 and Blake- 
mans's criterion is 2.2. 

,Z. ; Ofi ’i'rsin h>J' Lh)('.-iNI,r »n' ]h‘gJ’i\Ksl(H) in I'miuoiR-y Tis- 
Lrilnalnns,^ fJionpr/nAff, I, :'au-!irjll, 
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That the ability in question docs not consist oi mere intclligencG 
hut is definitely specialized is evident from the following. All 
the subjects had, on another occasion, taken the University InteK 
ligence Test—a somewhat modified army iilpha. Scores in this 
test eoiTciate with the criterion to the extent of only .IGiii.lO, 
whereas the corresponding covrelation^j for some of the special 
ability tests are between .40 and .50 and for their weighted sum is 
about .60* The regression o£ intelligence on criterion or vice versa 
is distinctly non-linear, for Blakemaifs formula gives values of 
4,9 and B.9 respectively. It would Ihii.s bo hazin'clous to at tempt to 
include intelligence in a regression equation of higher order. These 
facts indicate the advantage in as specialized a vocation as agri¬ 
cultural cngineGring of devising tests for the apucihe purpose in 
question. 

INTERPRETATION. 

If the tests above described are given to an iiuUviduiil for pur¬ 
poses of vocational guidance or selection it is necessary to iiiLcr- 
preL the scores obtained. This may be done in various ways. The 
sum of the test scores weighted by the coefficients of the independ¬ 
ent variables in the regression equation must of course be com¬ 
puted, This sum may then be taken as the most jn’nhal^le voca¬ 
tional ability of the individual and interpreted, reliitivo to the 
norms, by considering the standard error of estimate. For in¬ 
stance a normal frequency curve may be drawn with Uns weighted 
sum of test .scores as the mean and the standard error of estimate 
as the standard deviation of the curve, or by the use of ii tabic 
of the probability integral the chances may be expressed of the iii- 
dividuaTs ability falling witiiin certain assigned limits. 

It is perhaps better to develop the interpretation in general 
terms. It is possible with any correlation coefficient to derive fz'om 
the tabic of the probability integrid a ten by ten fold table which 
expresses for any assigned decile in one variable (test) the probable 
distribution throughout the various deciles of the other variable 
(vocation). Such a table may be used to predict what per 
cent of the persons in a given test decile will be in any voca¬ 
tional decile, or to predict for a given individual who scores in 
a certain test decile his chances of being in any vocational decile. 
The table below represents such a distribution for a correlation of 
.CO. Some slight adjustments were made to avoid unnecessary de¬ 
cimals, In the columns at the left arc given the limits of the de¬ 
ciles of test scores. The first column gives such limits lor the 
weighted sum of the seven tests and the second column for the 
weighted sum of the two tests in the shorter regression equation. 
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Test deciles 



Vocational deciles 




Seven tests 

Two tests 

1 

2 

3 

4 

5 

G 

7 

8 

9 

10 

.SO to ? 

.64 to ? 

42 

20 

13 

10 

6 

4 

3 

1 

1 

0 

.63 to .73 

.42 to .63 

20 

20 

16 

13 

10 

B 

6 

B 

2 

1 

.33 to .52 

.26 to .41 

IB 

15 

16 

13 

12 

10 

8 

7 

5 

1 

.16 to .32 

.13 to .26 

10 

13 

13 

13 

13 

11 

10 

8 

6 

a 

0 to .15 

0 to ,12 

6 

10 

12 

13 

13 

13 

11 

10 

8 

4 

0 to -.15 

0to--12 

4 

8 

10 

11 

13 

13 

13 

12 

10 

6 

-.16 to -.32 

-.13 to -.25 

3 

6 

a 

10 

11 

13 

13 

13 

13 

10 

-.33 to -62 

-26 to-,41 

1 

5 

7 

B 

10 

12 

13 

16 

15 

13 

-.63 to -.79 

-.42 to-.63 

1 

2 

5 

6 

8 

10 

13 

IB 

20 

20 

-.80 to-? 

-.64 to -? 

0 

1 

1 

B 

4 

G 

10 

13 

20 

42 

For exninple suppose an 

individual scores 

.65 

in 

the 1 

3um 

ot 

xne 


seven tests, This places him in the second hie’hcst decile. Then 
the chances ave 20 out of 100 that he will be in the highest decile 
in the vocation, 20 out oi 100 that he will be in the next highest 
vocational decile, 15 that he will be in the third decile, 13 that he 
will be in tho fourth, 10 in the fifth, etc. By a decile of voca¬ 
tional ability is meant of course ability like that possessed by the 
given tenth of the gi’oup of students on whom the tests were 
standardized. A general tabic like the above is preferable to the 
scatter nlot of the final R of multiple correlation between weight¬ 
ed test scores and criterion because it gives smaller IncreTnentsj. 

The above example is typical of the use of the tests for voca¬ 
tional guidance. It makes it possible to tell the student something 
about his chances of success in this type of work If the tests 
are to be used, on the other hand, for vocational selection it is 
necessary to .select on the basis of the above distribution table a 
critical test score and admit to tho agi*icultural enedneering course 
only those who exceed that score, Tlie in'obabie calibre of stu¬ 
dents admitted or rejected on tlio basis of such critical score can 
be dctoi'inincd from the table. If, for example, those w'ith a 
score alg'ebraically less than-,80 are rejected the expectation is 
that none of the highest tenth of vocational ability has been re¬ 
jected but that 42 per cent of those rejected are in the lowest 
tenth of vocational tibility, 

Summary 

Mental tests were devised for the purpose of predicting ability 
in agricultural engineering and were .standardized upon 43 stu¬ 
dents specializing in that subject. The tests w'cre given in two 
installments by means of mimeographed blanks, using the group 
method. Eighteen test variables were evaluated by means of 
throo instructors’ ratings. These ratings were made on a linear 
scale, reduced to the ratio of x to siyvid for each instructor and 
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these converted measures avoj-figed for each subject. The final 
aelectiou of tests was based on inspection of scatter plots for the 
18 test variables against the vocational variable. Eight tests were 
retained, correlated with the criterion, intercorrelated and the re- 
ft'ression equation derived. 

The correlation between the criterion and the sum of the eight 
tests weighted according to this regression equation (one weight¬ 
ing was zero) was about .60. However two tests carried most of 
the load and when weighted according to n regression equation in 
three variables their sum correlated with the criterion almost as 
highly as did the eight. Intelligence, on the other hand, had a 
correlalion of only .16 with the vocational variable, which gave 
further justification of the effort involved iii devising special 
ability testa. 

For interpreting the results of the ta.stH when given for purpose.'; 
of voeatioiial guidance or selection n ten by ten fold table for the 
correlation of .GO and its standard error of estimate was derived 
from the probability integral. Knowing an individual's weighted 
lest score it is possible with such a table to stiiLe the probability 
of bis attaining nny assigned degree of ability in agriciiltiiral on- 
giueeving. 
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Third Annual Educational Conference Conducted By The 
College or Education, Ohio State University, 

On April 5, 6 and 7. 


Nearly 3A00 Ohio educators took advantage oi the opportunity 
to attend the Third Annaual Educational Conference which the 
College of Education, Ohio State University, conducted at Colum¬ 
bus on April 5, 6 and 7. This attendance marked a decided in- 
crea^re over that of 1922 and emphasized, quite graphically, the 
increasing interest which the school people of Ohio are showing 
towards these yearly conferences. 

Three general meetings, 24 sectional meetings, and several ex¬ 
hibits were lumped into the three-day gathering as the formal as¬ 
pects of tlie conference. In addition to this array, however, there 
were many informal luncheons and dinners of various groups 
which were so successfully attended and so thoroughly appreciated 
that they threaten to become a regular feature of the conference. 

The keynote of the conference was that of '^Objectives in Educa¬ 
tion’' and all of the meetings were guided by this in their diseus- 
Eions. The summary of the meetinga which will be published at an 
early date are expected, thcrefoi’o, to be a valuable’ contribution to 
the literature on educational objectives since the discussions 
touched on all phases of education as well ns on the field as a 
whole. 

One of the interesting sectional mecting.s was that conducted by 
Dr. H. H. Goddard on Clinical Psychology. Dr. Goddard presided 
at the meetings and conducted a Clinic on Lho examination and 
diagnosis of children. Children from the Co lu in bus schools were 
used as subjects. Mabel R. Fernald, director of tlie vocation bu¬ 
reau, Cincinnati, spoke at this meeting on “The Service a Clinical 
Psychologist Can Render the Public School Teacher," and the 
“Value of the School Psychologist in Personal Work With Pupils" 
was discussed by H. Austin Aildna, Western Reserve University, 
Cleveland. 

Other sectional meetings which were held were: biological 
science, commercial education, educational and intelligence tests, 
educational and intelligence tests demonstration, European history, 
high school principals' association, Latin, mathematics, parent- 
toaCher's association, teacher li'aining, American history, art, 
city superintendents, county superintendents, elementary princi¬ 
pals, elementary teachers, English, home economics, industrial and 
vocational education, junior high school principals, modern lan¬ 
guage, uon-biological science and physical education. 
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One of the attractive features of the ConferoncG was the array 
of speakers of national reputation who spoke nt the dilTerent meet- 
ings. Among these were: W. C. Bagley and S. S. Colvin, Teach¬ 
ers College^ Columbia University; C. H. Judd and Algernon Cole- 
nan, University of Chicago; L. V. Koos, University of Minnesota; 

A. Works, Cornell University; J. C. Miller, Indiana University; 

• nd E. W. Barnhart and P. W, Ballou of Washington, D. C. 

One of those chiefly responsible for the Conference has ex¬ 
pressed himself as follows: “The remarkable attendance is most 
'■ncouraging to us in this Undertaking to make the Annual Educa- 
'ional Conference a vital factor in the life of the Ohio school sys¬ 
tem. And the concentration of all the meetings on the problem of 
selecting clear-cut objectives has meant a clarifying of the aims 
which the Ohio school people are using as a working basis in the 
moulding of this system, 

"We were especially gratified this year by the participation in 
our educational program by people whose interest is not primarily 
educational, such as the business men who aided in the discussion 
before the commercial education and the industrial and vocational 
education groups, and too, the meeting conducted for the parent- 
teachera' association. This gives us a definite point of contact 
with the people who are supporting the school system and their co¬ 
operation makes it easier for us to plan and eonduci our work ^ 
with greater effectiveness.-'^ 



BOOK REVIEWS 

Knight DunlAT, The Elemeutn of Scientific Piiychoio^ij, St* 
Louis, C. V* Mosby Co. 1922. 368 pp. Price, $3.50. 

In Ibis book Prol. Dunlap has attempted to sift from the i^Teat 
mass of psychological material that essential residue which will 
he rioedccl by the atiulent of flcionti/ic psycholog'y when he comes 
to deal with the world of ^Vetil objects and real activities.” While 
in no scnsic an attempL at applied psychology it is a very decided 
attempt to present the facts of psychology in such a way that 
their application will be possible. The book is intended prinmi’ily 
for college stndeiiU, but tho nuLhor assumes that it will also bo 
found useful to the general reader who (lesii'es to know the fun¬ 
damental a of psychology but has no teacher. 

The general content of the book may be inferred from the 
following resume: A*n introdiicUon dealing with* the nature and 
divisions of psychology^ four chapters dealing with sense per¬ 
ception, the senses, rind sensory qualities; two chapters on sensory 
relations and sensory measurements; two chapters on thinking 
and thought proccsi'cs; one chapter on tho bodily mechanism; two 
chapters on reactions and re action types; two chapters on per¬ 
ception; one chapter on all'ectivc processes; and one chapter on 
the empirical self. Two appendices complete the book; the first 
deals with mental doJiciency nnd mental disease; the second with 
choice refurencQs grouped umlGr certain general divisions. 

The following views gleaned from various parts of the text 
iilustrate the author's typicnl attitudes; Science must be scrupu- 
louslv exact in the use of its torms^ and must furnish exjieri- 
mciital proof for all accepted hypotheses. Anecdotal evidence is 
the bane of pseudo science. The term sensation is replaced by 
the Icrjn srnD'cjn/nm ns lacing Ic.^s confusing. Stimuli ni‘G clnssi- 
licd as physical, unresolved (without mabhcmatlcal expression,) 
and inadocpiate (unusual.) All sapid substances must be soluble 
”in Wider.” CJassilicaLions of odors based upon the method of 
exhaustion arc futile, a more hopeful method will follow more 
nearly the chemical method of Uamsay. Color vision is based on 
R flight oi the Y^?ip?g-H£.Ombo]tz th(^ry, the 

tary colors of ^Yhich arc red, blue, and chi or (yellow-green,) The 
pigmental cells of the retina protect the receptors from too great 
stimulation in strong illumination. Pitch Ls* the ex tensity charac¬ 
ter of tone.s, and clepend.s upon the degree to which the entire 
tectorial membrane is excited. Pitch dilferoncos at first imprecep- 
tible are readily prcceptiblc after sullicicnt practice. The ampullar 
and vestibular receptors of the ear have no true sensory function, 
but give rise only to reflexes in skeletal muscles. Weber’s law 
IS responsible for the fail Lire to determine many nmcli needed 
constants of range and threshold values. The term conditioned 
re flexed as frequently used is a misleading term. The contrast 
between instinct and habit has been ovorstressed in the past, 
Intelligence ia ii term having many meanings, and as far as it 
relates to intelligence tests may be defined as "whaLever intelli¬ 
gence tests measure.^' Sound localizations in the median plane 
of the body are made possible by timbre alone. The semi-circular 
canals arc of doubtful function in equilibration. The eye is blind 
during the saccadic moveinenta of the eye, as in reading. Mean¬ 
ings do not essentially depend upon mij.5cijlar movements. Asso- 



191 


BOOK REVIEWS 


ciation is only a special case of habit forniation, and occurs in 
exactly the same way as does all serial connections. 

Throughout the book the author is vigorous and gtimulating^ 
his language is not involved and one cannot avoid catching his 
ha agrees with, it or uot. While the author has 
given credit to all authorities cited he has not done so in a 
way which would permit the reader to refer to the original sources 
without considerable didiculty. This omission might bo a serious 
handicap to the general reader who knows little of the psycholo¬ 
gical literature, in fact the serious student of psychology would 
feel a littla more at ease were the opposing views sot aside with 
more opportunity to investigate the sources of authority. All in 
all the book is well worth reading because it is so diiYerent from 
the usual presentation, if for no other reason, 

Ohio University C. H. Growdon. 

Robert IVIacDolTiAll, Ph. D,, The General Problems of Psi/- 
cholofjif, The New York University Press, New York City, 1922, 
pp. 464. 

That applied science must be grounded in solid general scien¬ 
tific principles is obvious- Almost as obvious is it too, that general 
science must be based upon satisfactory methodological principles, 
nlthough this latter situation is frequently overlooked. Too tnuch 
by far of our scientific work is conceived and executed witli faint 
or no regal'd to the indispensable methodological background. In 
consequence our science is not nearly so free from serious de¬ 
fects as it might bo. 

In psychology especially must the methodological background be 
constantly kept in mind, for not only is psychology concerned with 
phenomena which arc the most diflicult of any to investigate, but 
also psychological science is, more than any other, a direct de¬ 
rivative from more elementary ways of thinking. 

To the thoroughgoing analysis of the methodological perspective 
of psychology Professor MacDougall devotes the present volume, 
Very he point ont Sow sorioxis nniV ubstTxictive nro 

the misconceptions which arise when psychologists are not fully 
oriented with respect to the nature and purpose of the coiicep- 
Lions guiding their w'ork, “The individual^ may be an acute ob¬ 
server or a patient scholar, but, if the guiding assumptions of his 
w^ork bo mistaken, the force of every gift he possesses further 
subverts the purpose of research and hinders progress. The 
work done under such conditions is not merely negative- It is an 
obstacle set in the way of knowledge, whose acrioiianesn is nronor- 
tionate to Ra bulk.” 

The more positive results derived from a thorough acquaintance 
with the iiiethodological pre-suppositions which the psychologist 
Lises, not only make for rapidity and security of scientific advance, 
hut also insure the avoidance of insidious misconceptions- Pro¬ 
fessor MacUoiigall in the following quotation eniiineralea some of 
these misconceptions which have been made in the past. "The 
mind's activity is not determined by a sufficient body of induc¬ 
tions to make its speculations rational. Fantastic hypotheses are 
shaped. Gross perversions of the meaning and scope of science 
arise. Methaphysical and theological concepts invade its terri¬ 
tory, The thinker turns from the patient exploration of fact 
to spin deductions from a system of a priori definitiona. Pact 
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and myth are interwoven in a new unitary complex. The natural 
connections of cause and effect arc supplemented by essences 
and forms, magic and miracle, as method shifts iinpredictably 
between theological interpretation and explanation in terms of 
natural law.'* 

The treatment which Professor MacDougall gives to the general 
problems of psychology is at once comprehensive and thorough. 
He discusses not only the relation of psychology to knowledge 
in general and to the arts of life, but the field, the limits, the 
methods, data, and specific problems of psychology. It is not 
necessary to be in full agreement with Professor MacDougall to 
appreciate that this book is of considerable importance and well 
worth the perusal of every serious student of psychology. 

A. A- RouacKj Behaviorism and Psycholooi/, University Book¬ 
store, Cambridge, 1923, pp. 284. 

As its title indicates ‘'this book has had for its purpose the 
confutation of the claim of behaviorism to the title of psychology.” 
Although the nuthor summarizes his destructive eiforts in the 
following statement, that statement does not convey in full force 
the severely critical judgment he really entertains of the behavior- 
ists. 

”I have tried to show that (1) the concept of behavior is too 
general to afford us the foundation for a separate science^ (2) 
behaviorism, in its restricted sense, seeks arbitrarily to dominate 
a field which is not, cx hijpikcsi, under its jurisdiction by bowing 
out of court everything which does not fit into its narrow frame 
work, and (4) behaviorism does not readily lend itself to appli¬ 
cation.” 

How then is the work of destroying such a '■'generol” and worth¬ 
less movement ns behaviorism carried out? Briefly, by putting all 
the behaviorists into one group and attacking all through '^at 
the author considers the weakest point in each of the very few 
that he slightly examines. 

Similarly, behaviorism is deprived of all applicational value 
by the simple method of assuming that only mentalism is psycho¬ 
logy. in conseciucnce of this fact, it is asserted that if one wishes 
to handle situations involving intention, belief, intelligence, ideas 
and emotions, or other such psychological facts, behaviorism can¬ 
not be of any service at all. 

Indiana University. J. R. Kantor. 

Edward Allswortii Ross, The Social Trend, Century Co., New 
York, 1922, pp. xxii and 235. 

War, prohibition, “philanthropy with strings,” women in the 
home and in a man-made world, migration, the vanished frontier, 
the birth and death rates, a legal dismissal wage: such are some 
of the topics considered in this collection of papers. It were vain 
to call it a book. 

AVritten with all the very great attractiveness of Professor 
Ross' style, fearless, filled with interesting views, the volume 
deserves a wide reading. 

Perhaps none of these papers is more acute than the one on 
"The Legal Profession from the Social Point of View” or the fol¬ 
lowing one on “The Conscience of the Expert.” It is shown that 
the skill of able lawyers retained by the wealthier, and when 
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wi’onff more reckless side, bends to whittle down the defenses 
of the law. The lawyer is in larffe measure e^.^'a^’C(l in an anti¬ 
social underfcalcinff. Compare with him the true expert, the product 
of modern training in scientiflc method, possessing the scientists 
love for truth and you have almost a complete antithe.sis. The one 
aims to establish n point oX view, his side, whether true or false, 
against the assaults of his brother lawyers; the other Lo wre.st the 
truth from nature and report it. Society should and make 
more use of the scienLihe expert, not so nuicli because he has a 
special method or special knowledge, but heciuisc lie li;is a con¬ 
science sensitive bo truth. So be it. 

All of these papers deserve inclusion in the collodion and tlicir 
very variety serves to indicate the diversified social trends of a 
complex social order. 

D, F. HaugiiT, The Interrelation of Souie Hif/hcr Lcarninf/ Proc- 
eses. Psychological Monographs, Whole hjo. 139. Princeton, K. J. 
Psychological Review Co. 1921. pp. vi and G9 

This is a study, with very complete statistical discussion, of 
some so-called higher learning processe.s, ^Tational learning,'^ 
“checker puzzle,^* “Tait labyrinth^* and others, and n comparison 
of the results of these with the results from the Stanford-Bin et. 
The intei’correlations are low and conflicting and the conclusions 
arc therefore adverse to the Spearinnn “Two Factor Theory“ of 
intelligence. Are logical conditions and factors in learning* on the 
whole less determinative than such matters as emotional stability 
or disturbance, perseverance, sg11-cquIi*oI and so forth? 

The Professional E(htcation of Teachers in Cleveland. Cleveland, 
Ohio, Division of PublicationSj The Board of Education. 1922, 
pp. X and 92. Price ? .50 

We have here the report of the Educational Commission which 
was appointed to study the subject named in the title. This Com¬ 
mission was composed of Professors W. C. Bagley, J. W. Withers 
and Geo, G. Chambers. The p amp hie L discusses and makes rcc- 
DTmfneTidatioTiB. on tVio aiTillntioTi between the Cleveland tlcbool of 
Education and the Western Reserve University. It considers ad¬ 
mission, organization, curricula, finance and other ]'‘roblems nnd 
gives in appendices a number of documents which show require¬ 
ments and organization of this important joint venture in the 
pre-service and in-service training of teachers for a great city. 
The report is an important contribution to current discussion of 
teacher training. 

R, G. JoNLS, Survey of Depart of Instruction of the Cl eve- 
land Public Schools. Cleveland, Ohio. Division of Publications, 
Board of Education. 1922. pp, 29. Price $ .50 

This is the first of a series of continuous surveys to be conducted 
by the Department of Research of the Cleveland Schools. It 
provides a brief analysis of the educational operation of the 
school system. There are diagrams and tables on enrollment, pro- 
niotion, age-grade conditions, nehievements in individual subjects, 
the work of the psychological climes, etc, The material was ore- 
pared under the .direction of Dr. W. W. Theisen. - 
Arthur L Gates, The Psychology of Zi cadi no and 
with special veferejice to disability. Teachers College, Columbia 
University Contributions to Education, Mo, 129* New York, 
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Teachers College, Columbia University, 1922, pp. viii & 108. 

It is sixteen years since Huey published his excellent summary 
ol the psychology and pedagogy of reading. Since that time 
a grent quantity of experimental and clinical work has been done 
in the field of reading, speech and spelling; and in consequence, 
it is becoming apparent that the difficulties involved are only 
no^v slowly emerging, The solutions arc still to be sought. 

The present iiivestigaiion was carried on nt the Scarbrough 
School, Scarborough, New York, Dr, Gates had the good iortune 
to work with a group of pupils of normal or superior intelligence 
hut who yet innnifcjaLed the reading or spelling difficulties which 
.form the subject ol study. A number of group tests of general 
mental ability, of acliievcmont in school subjects, of responses to 
a variety of visual and auditory stimuli and of several sensory 
niechanisin55 and motor responses were given to a group of one 
hundred pupils in grades III to VIII, Detailed individual testa 
of mental ability, ns the Stanford-Dinet, and of specialized abili¬ 
ties in pronounciation, word perception, etc., were also given, The 
investigation was canned out with considerable detail and great 
care. 

In a short review it is impossible to make any adequate report 
of the study, In the first part of the volume it is shown that 
there is an ability common to reading, the recognition of correct 
spelling, proof reading, and the ability to detect differences be¬ 
tween pairs of siinilnr words. It would seem that both for pre¬ 
diction and for diagpoaiB the value of any one of these tegts is 
minimized by the fact that they are applicable only througli the 
use of material which has already been learned; and that the 
worfcli of showing that Lhei'e are psychological elements common 
to reading and proof reading, for example, is not great. 

It appears that the most fruitful portions of the study are the 
short reports of individual difficulties in reading and spelling, (See 
pp. 41-42 and 66-G7, etc.) It may at least be seriously questioned 
whetlier we will ever get very much further with group studies 
of reading defectives until after we have made more detailed 
and critical studies of a large number of individu-al cases and 
defects. 

An interesting conclusion, in view of the work of Huey and 
hia successors, is the statement that inappropriate eye move¬ 
ments are not the cause but only a symptom of poor reading, and 
even then, not the symptom most easily observed, (p. B7) 

Concluding chapters deal with an analysis of abilities involved 
in spelling and present criticism of various theories of the causes 
of backwardness in reading and spelling. 

Perhaps the most important conclusion of the study—and it 
is certainly an important one—is that presented in the following 
sentences: ^*A case of inability to read affords, frequently, a 
tangle of difficulties that experts from several professional fields 
working together may be unable to disentangle. Such a situation 
portrays clearly the need of a new group of specialists who will 
make the solution of such problems their main work/* (p. 106) 

Ohio University H, G. Good. 
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Henry E, Jackson, Robinson Crusoe, Social Enr/iiieer. E. P. 
Dutton, New York. 1922. pp. 301. Bibliography of more than 
GO titles. 

The author divides discussion into three parts. In part I he 
describes at length the character of Robinson Crusoe. He sees 
in him a typical Anglo-Saxon actuated by the gospel of work and 
of courage, Crusoe is represented aa meeting mnnerous discour¬ 
agements from which he Uums unshaken and vinafvaid. 

In part II the author presents certain essential charncteristics 
of the industrial situation as it is found today. The author nmin- 
taius that the source of the dilliciilLy i.s found in the fact that the 
principles of feudalism control industry today, Industry fails to 
recognize the equality of man a principle which has been rec¬ 
ognized for more than a hundred years in politics. He doc 1 area 
that industry in this particular is a century and a half behind 
politics. Politically men are equal but industrially the old re¬ 
lation of lord and vassal maintains. 

In part HI the author proposes a solution for the industrial 
problem. In brief he declares that the solution will be reached 
when a new attitude of mind has taken possession of those who 
supply capital and those who supply labor. This new attitude of 
mind must recognize the principle of manhood—the right of each 
individual to a proper return upon his investment whether this 
be in terms of capital or labor, In a word it is a plea for in¬ 
dustrial democracy. 

The book is full of optimism and faith in the future. The author 
does not attempt to list successful applications of the new cloc- 
triiiG. He is concerned only with the presentation of a principle 
of conduct, His discussion is clear and compels consideration on 
the part of the reader. 

Prank G. Pickell, Junior High School Mathcinatics. Cleveland, 
Board of Education. 1022, 

This is a course of study and syllabus for mathematics in the 
Junior High School in Cleveland. In this syllabus material suit¬ 
able for mathematics in junior high schools has been organized 
along lines independent of the traditional oi*ganization. In the 
7th grade graphs, fundamental processes, business forms and 
accounts, equations, and percentiige with its applications, are 
outlined. In the 8th grade the fundamental processes of arith¬ 
metic are further considered and advanced work in the application 
of percentage as well as intuitive geometry are treated. In the 
9Hr grade emphasis is placed upon algebra. In the treatment of 
algebra in this grade one important change from the traclitional 
sequence has been made; factoring and simultaneous equations 
change places. 'JThis change has been made first to stress at the 
outset the equation as the most valuable tool in the solution of 
problems and second to prevent the wa.ste of time to the 913 
pupils/' 

Kline-Carey. The Revised Measuinng Scale of Fvce^liund Draw¬ 
ing. The John Hopkins Press. 1923. Price $ .GO. Baltimore, Md. 

This is n, revision of the authors' earlier scale for measuring 
free-hand drawing. The revision presents a scale for measuring 
achievement in the drawing from memory of distinct types of 
objects. These objects are: house, rabbit, figure in action, and 
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tree. This has made the merit of furnishing an instrunient for 
measuring achievement along special lines. 

Ohio University. W. L. Gard. 

William T. Root, Jr. A ^ocio-PsycItological Study of Fifty- 
ikrae Supernormal Children, Psychological Monographs Vol. 
XXXIX, Psychological Review Company, Princeton, N, J., and 
Lancaster, Pa. 

This study of supernormai children was iindertaUen because the 
author felt the importance of the Superior Child to the state and 
because the lack of information concerning the factors making 
for superiority give the subject peculiar interest. The aims of 
the study are mainly to compare the behavior of the superior 
child with that of the normal child; to note the individual 
differences of the superior mind in methods of procedure, imagery, 
associative and mnemonic devices; the qualitive character of 
their responses; and to try to discover the signiffcaiice of definite 
systems of training, by incidental education, and the social 
milieu. 

The children for this research were selected from the city of 
Los Angeles. The preliminary selection was made thru the schools, 
newspaper accounts, etc. The final selection was based upon the 
results of Binet Tests scores and special ability along some line. 
Several tests were used in the experiment, such as Binet Letter- 
Square, Trabue Completion Test, Healy-Fernald Construction 
Puzzle, Proverb Test, etc., and the different phases of mentality 
studied. Not only the Psychological test given to discover the 
]uental ability of each child were studied, but the social histories 
were thoroughly investigated. The effects of home life and 
training upon the mental development of each child were carefully 
considei'ed. 

The author’s conclusions are most interesting and valuable to 
the research student in this field, Mr. Root has reserved no time 
and energy in staling clearly what he discovered in this work 
with bright minds. 

Ohio University LaVinia WARf^ER. 

Thomas Verneh Mooiie. PERCY BYSSHE SHELLEY, An In- 
traduction to the Study of Character. The Psychological Mono- 
nogniph, Vol. XXXI. No. 2. Whole No. 14, 1922. 

This monograph is an important and stimulating endeavor to 
apply the literary-historical method of psychoanalysis to Shelley. 

In the authorns analysis of the mentality of the poet he finds, 
first of all, the ’'precox elements of negativism and defense.” He 
is firmly of the opinion that Shelley’s plan of life, or its chief 
di’iving foi’ce consists of an "aiTeefcive drive for an object of 
sensuous love” and an intellectual drive colored by protest. 

In the development of his thesis the writer seems to insist upon, 
the idea that the prime dominating motive force of Shelly’s life 
was his yearning for a beautiful woman who could unreservedly 
appreciate him and hia poetical capabilities. In support of this 
view he draws chiefly upon las tor. However, a question of 
once arises as to whether this poem^ should receive the inter¬ 
pretation that Mr. Moore appeal's to give it. Ci'ifcics have largely 
agreed that in this significantly autobiographical poem the Poet’s 
quest of the lovely maiden may be any poet’s quest of ideal 
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beauty_such beauty as is celebrated in the Hymn to hit dice Inal 

Beauty. And although one readily concedes that Emilia Viviaiii, 
more or leas directly inspired Epipsycliidion, one much prefers to ■ 
g-ive the later poem a spiritual rather than ii literal signification, 
Shelley here emplmsizes a fact so oxLcn expressed by him that a 
poet must ever sock the elusive beauty of life and poetry and 
that when he attains to such only disappointment and failure must 
ensue. The ideality and unrealized end of the pursuit are the 
agencies impelling a poet. Had the Poet in AUmtor aiLiiiiied the 
allunng object of his love he would have experienced defeat in 
the very fact of* his realization; only the continuous striving 
toward her brings richness or reward. 

As a potent influence in Shelley's life Mr, Moore cites the 
poet's relationship with Harriet Westbrook. Pie finds little jusfcU 
fication for Shelley’s conduct. It is to be admitted that even the 
inost enthusiastic admirers of Shelly cannot nialce an altogctlier 
satisfactory brief for him. However, it is gratifying to the 
lovers of Shelley to note William Sharp's assurance that Shelly's 
“sorrow and life-long regret for the malfortiinnle outcome of 
his action were genuine.” 

Mr. Moore well points out the element of protest in the poet's 
character. But one questions whether this factor is wholly, or 
even largely, due to the "father complex.'' One is inclined to 
hold that the Sion House experience, more than any nlhcr, en¬ 
forced, If not implanted, Shelley's hatred of tyranny. Uiiqucs-' 
ti on ably there is some dilTerenco of opinion as to the poet’s home 
relationships; but all agree iis to the extreme distress he suffered 
at Sion House. Mr. Moore draws upon the Promotliens myth to 
illustrate his convictions in this in.sLaiice, 

The Prometheus theme, n very popular oiio in literature, per¬ 
haps cannot be summoned to demonstrate anything peculiar to 
Shelley, True the poet employs it as n medium for his expression 
of the overthrow of all forms of tyranny and his installation- of 
the Golden^ Age. Demogorgon, a name which in the drama no 
longer carries any connotation of magic, i.s by the poet do lined ns 
“Eternity.” Shelley has not identified him with mere Necessity 
because he too strongly personalizes the character; for instance, 
the closing pronouncement of the last act. The poet’s dream 
reaches its most vivid delineation in the eternal union of Love 
and Humanity, 

Chapter IX of Mr. Moore's article contains a brief analytical 
summary of the Shelley profile. It is reasonably comprehensive. 
As has just been indicated one is inclined to differ from the latter 
test against all authority rooted unconsciously in the hatred of 
portion of the second predication, namely, “The bold, violent pro- 

Books and pamphlets for review should be sent to James P, 
hi5 father,” Perhaps one might suggest that greater emphasis 
sliould have been placed on Shelley's generosity of soul. The 
philosophical-religious aspect of the poet's mind has not been 
noted. ^ On an earlier page Mr. Moore refers to Shelley's homo- 
sexuaUty. EoTtunately this is omitted in the profile. It would 
be difficult to detect this element in Shelley's mental constitution. 

Mr. Moore's careful and scholarly work ia, in most respects, to 
be warmly commended. He has given us an elective attempt to 
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n seer tain the mental traits that most palpably have revealed 
tilemselves in the operations of Shelley^s mind, 

Ohio Univei’ftity Hiram R. Wilson, 

The Honesty Booh. Prepared and published by The National 
Honesty Bureau, 115 Broadwtiy, New Y.ork, 

A textbook for schools written by business men instead of by 
pedagfogues, a good idea. IliUierto the most recent illustration in 
schoolbooks of businoHS honor have been taken from such remote 
exainples ns Benjamin Franklin and Peter Cooper, This little 
book begins with ii talk about a modern oflicc-boy, tells how a 
young man today gets a bond and it is replete with references to 
tlie business practices of our own lime, The Nnlional Surety 
Company has originated the plan of reviving Lho commandment. 
‘^Thou shalt not steal/' in the schools and has had the stories and 
methods tried out successfully in real schools by teachers with 
actual pupils. The .itories are crisp, pointed, unconventional and 
avoid the goody-goody. 

The volume is an interesting attempt to demonstrate how a par- 
'fcicnlar virtue may be inculcated. Ita suggestions give proinise of 
being helpful to teachers in tesiching other virtues. The book 
and the campaign of which it is the instrument are to be heartily 
comm ended, 

Oliio University 


jAfliEs P. Poster, 
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THE RETURN COUPON AS A MEASURE OF 
ADVERTISING EFFICIENCY 

By a* T. PoFFBNnEnGKii 
Colujiibiii University 


When the psychologist offers a device for measuring the effect¬ 
iveness of advertisements, such as the Order of Merit Method, or 
one of the Attention or Memory methods, it should be evaluated 
not in comparison with some ideal method but rather with the 
other actual methods in use with which it would have to com¬ 
pete. In investigating current methods of measuring advertising 
e/hciency the writer was surprised to discover the reliance which 
is at present placed upon the return coupon as a measure of the 
value not only of a particular piece of advertising copy, hut of 
an advertising medium which carries the copy. This reliance 
seems not to he limited to cases of strictly mail order selling, 
but is extended to cases where the product may be purchased 
directly in any locality, and where the return coupon concerns 
merely samples or descriptive literature. Publications have been 
Irnown to lose valuable clients because the number of "replies" 
through that medium do not come up to expectations. There 
must be many factors determining whether readers of a particular 
medium will or will not indicate their interest in advertised 
articles by filling in and mailing a return coupon. The price of 
a magazine as well as the nature of its contents, determining the 
charactei’ of its readers; its editorial policy such as that of ad¬ 
vocating buying from local dealers; the distributioii of readers 
in city and country; all may give clues to the possible attitude 
of the reader toward the return coupon. In addition to these, 
there are other more strictly psychological factors involved, 
These, like most others which determine the human reaction to 
advertising, can be discovered, by painstaking research. TMs 
report deals witli conditions that are not peculiar to a7iy one 
medium, but rather with the offcctivencsa of the return coupon 
in general. Two of these will be discussed, namely (1) the de¬ 
pendence of efTectiveness upon attention value, and (2} the clc- 



m 


POFFENBEIIGER 


pendence of elTectivencas upoi^ case of UKing the coupon. 

1. A casual survey of any magazine will provide ubundanl 
evidence of the lach of at ten ti on-get ting power in the return 
coupon. Its size ia usually reduced to n minimum; its position 
is at the extreme bottom of the advertisement or in a lo-wcr 
-corner, with none oi the custom ary mechanical devices employed 
io carry the eye to it; its type ia email and plain. It would seem 
that a reader might well have Ms interest aroused in the article 
advertised and yet fall to be stirred to action by the appeal of 
the coupon, or worse still inight fail to notice the coupon at all. 

To test the attention value of return coupons in comparison 
with the advertisements that carry them, n simple experiment 
was niTanged. Six full page advertisements (black and white 
only) were taken from the October 14 issue of the Saturday 
Evening Post. Three of these contained return coupons of the 
usual sort, while the other three had none. This set of six 
advertisements was presented to 210 persons each of whom was 
asked to examine them as much as he liked, but move carefully 
than he would in looking over Q magazine. Immediately after 
this examination wag finished, the advertisements were withdrawn 
and each person was asked to write the names of the articles 
iidvertised. The test was made extremely easy by using only six 
advertisements and testing for knowledge of them iminediately 
after so that as large a proportion of the people tested as pos¬ 
sible should vemcmbcT all of them. That most of the persons 
did remember all the advertisements may bo seen in column 3 
of the accompanying table, where 189 of the total of 210 re¬ 
membered the advertisement making the lowest score and 202 
of the total of 210 remembered the one making the highest score, 
lb will be noticed that the six advcrbisGincnta were nearly equally 
well remembered. 

As soon as the names of the articles advertised had been 
^written, these sheets were collected, and others. containing a 
printed list of these articles were given to each person with in¬ 
structions to check those articles whose advertisements had re¬ 
turn coupons. The results of this test are given in the table. 
The first column gives the name of the article advertised, columns 

2, 3 and 4 give the number of persons who recalled each ad¬ 
vertisement. The scores for men and women are reported separ¬ 
ately, in columns 2 and 3 and arc then combined in column 4. 
^Jolumns B, 6 and 7 give the data for the recall of the coupons, 
'fi and 6 giving the records separately for men and women and 
'7 combining these into a total score. The /Irnt three advertiae- 
-ineufs m the table contained return coupons while the hist three 
contained no coupons. The lower right hand corner of the table— 
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figures followed by an (*)—represent the cases where ad- 
vertiaementa were said to contain coupons when they really did 
not. Disregarding the records for men and women separately, 
we find that 30, 66 and 31 persona reported falsely concerning 
the presence of coupons. These figures indicate the degree to 
which guessing occurred, and furnish the means for calculating 
approximately how much guessing occured in the case of ad¬ 
vertisements which really did have coupons. This may be done 
roughly as follows: It will be observed that the last three ad¬ 
vertisements were recalled by B92 persons and of these 116 or 

NUMBER OP RECALLED RECALLED 

PERSONS WHO ADVERTISEMENTS COUPONS 


AlDVETlTISBMBTs'TS WITH COUPONS 


(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

Articles Advertised 

Men 

Women 

Both 

Men 

Women Both 

Fleischman's Yeast 

81 

109 

190 

40 

68 

108 

Booth's Sardines 

82 

110 

192 

18 

31 

49 

Underwood Bookkeeping 
Machine 

83 

106 

189 

22 

33 

55 


— 

— 

-- 

— 

— 

— 

Total 

246 

325 

571 

. 80 

132 

212 


ADVERTISEMENTS 

WITHOUT COUPONS 

Styleplus Clothes 

88 

111 

199 

14^^ 

le* 

30* 

Squibb's Products 

86 

105 

191 

25’^ 

30* 

66* 

Apollo Chocolates 

91 

111 

202 

12* 

19* 

CO 


— 

— 

— 

— 

— 

-- 

Total 

265 

327 

B92 

51* 

6B* 

116+ 


about 20 per cent said they contained coupons when they did 
not. The first three advertisements were recalled by 571 persons 
and of these 212 or about 40 per cent said they contained cou¬ 
pons. But some of these persons must have been guessing and 
we may assume that about the same proportion guessed here as 
in the case of the last three advertisements, namely, 20 per cent. 
Making this correction, it would appear that only about 20 per 
cent of the people who recalled the advertisements recalled whether 
they had return coupons. As our correction for guessing is 
conservative, this 20 per cent is more likely to be too high than 
too loyv- 

Since the ultimate measure of the value of an advertisement 
is the number of purchasers it creates, the return coupon as an 
indicator of effectiveness should register more than 20 per cent 
of the attention and memory value of the whole advertisement. 
By giving it some of the attention power devoted to the rest of 
the advertisement, it might be made to register more nearly the 
value of the advertisement or of the medium in which it is placed. 
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Certainly if much reliance is to be placed upon the coupon to 
indicate these vnluea some effort should be made to bring it to 
the attention of the reader. 

The figures in the table showing the records for men and women 
separately both in the rcciill of advertisenirnts and in the recall 
□f coupons show only one difference worth noting. In every ense 
the scores for women arc higher than for men, a di/Toronce that 
is usually noted in testa of this aort. But the proportion oi 
coupons recalled to advertisements recalled and the proiiortion 
of guesses does not differ materially for the two sexes. Likewise^ 
no particular significance is to bo attached to the difference in 
scores of the different advertisements. They were too few in 
number to enable conclusions to be drawn about the value of 
types of coupons etc. The high coupon score for the Fleischnian 
advertisement is probjihly due to the large Glement of guessing 
in that case, but this cannot be doLermined definiLcly from our 
records. The iuduence of difference in sizc» poaitiou and layout 
of coupons is a matter which would be well worth investigating. 

M. The second condition upon which the effectiveness of the 
return coupon depends is the ease with 'which it may be used. 
There are a number of factors that might well be considered here, 
For example, the paper on which the advertiseuiont is printed 
may be too smooth to permit of pencil writing and too porous to 
permit the use of ink without its blotting. Again, if not perforated, 
the coupon may tear in being removed from the advertisement. 
These are dilflcultiea probably inherit m the medium and wluch 
cannot be remedied. But there is another, wliich can be more 
easily hendled. This has to do with the amount of space allowed 
for writing the name and address on the coupon. A glance at a 
collection of coupons will show that many of them aro entirely 
too short to receive an ordinary signature. Now, it may seem at 
first a very small matter to expect the reader to reduce his hand¬ 
writing sufficiently to meet the coupon conditions. Still, it must 
be remembered that in many cases, if not in the majority of 
thena, the decision to react or nob to react by filling in and mailing 
a coupon hangs on a very slender thread, The resistance which 
any slight obstacle offers may be just enough to sway the re-action 
ill the negative direction. 

A series of measurements was made of a random collection of 
110 signatures, and a series of 43& return coupons, some of them 
from full page and some from half page advertisements in large 
size periodicals such as The Ladica Home Journal and the Sat¬ 
urday Eveniny Post; others were taken from full page and half 
page advertisements in standard size magazines such as Scribners 
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Btid tlio Centnr]i^ Magazine. .The spaces allo^ve(l for both the 
si^nfttiivc and the address were measured but only the former will 
be discussed. The ncconipfinyrnf; chart will show graphically the 
degree to wliich tlic spaces fall short of accommodating the sig¬ 
natures. The horizontal scale for every curve represents the 
length of the signatures and the signature spaces in centimeters, 
flnd the vortical scnle represent-i the number of cases of a given 
length. The topmost curve shows the distribution of sif/natnre 
lengths, ranging from about 2.6 cm*, to about 11.5 cm., with the 
inedijin length at G.9 cm, The second curve shows the distribu¬ 
tion of signature spaces in coupons from full page advertise¬ 
ments in large size magazines; the third, in coupons from half 
page advertisements in largo size magazines; the fourth in cou¬ 
pons from full page advertisements in standard magazines; and 
the fifth in coupons from half page advertisements in standard 
size magazines. The solid line roprcseiiting the median length 
of the signatures is carried clown through the other curves, whose 
own niedians are represented by dotted linos. Although there 
arc a few coupons with enough space to accomodate the largest 
naines, the median of the names is considerably larger than the 
medians of any of the spaces. The relationship may also be 
expressed in terms of the pcy,cent of the signature spaces that 
equal or exceed in length the median of the signatures. These 
figures are given below, 




Median 

% Reaching 



Length 

or Exceed, 

No. Cases 

in Cm. 

Med. Name 

Signatures 

109 

6.9 

20 

Full page Ad. Large Size 

133, 

B.9 

20 

Half page Ad. Large Size 

55 

4.9 

20 

Full page Ad, Standard Size 

116 

G.O 

20 

Half page Ad, Standard Size 

22 

6.3 

0 (Approx) 

If the distributions of the 

spaces 

were equal to those of the 


signatures, there should be 60 per cent of the cases of the former 
exceeding the median of the latter. Thus in three of the cases, 
30 per cent of the names arc too large for the spaces, and in the 
fourth ense, they are about all too large to go in the space pro¬ 
vided. There appears to be an even gi’eater discrepancy between 
the height of writing space provided ‘and the height of space 
needed for the signatures, althpugh no actual measurements have 
been made to support this statement. 

Thai the space allowed for coupon purposes ia not limited by 
the size of the advertisem^onl is clear from the fact that the coupon 
in the standard magazines tended to be larger than that in the 



I Dlafcrtbution 
or 

Slgnatiure flpaoeg 

FUlX p^tge-aarge pl^e 



dstrtbKtil on 

or 

jSiigiiat3ii£*e apaoeo 
iBcdLir page*^Large slSe 



Med« 6»0 

Dl s-fen-bTiliion 

or 

Sit^atfure Spaceis 
Full page-SjnalT aiae 



Dtstrtbution 

of 

Signati^re Spaces 
Ualf page-'Small si'i^Q 

Med. 5*3 
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large size magazine, both for the full and half Tiage advertiae- 
aienls (medians of G.O and 5.3 compared with medians of 6i0 and 
4,0). The real reason in to bo nought in the failure to recognize 
the importance of providing adequate space. Adults have their 
writing habits firmly established, so much so that writing a signa¬ 
ture or an oddreas Is quite automatic. Interfei'ence with the 
smooth Dow of the DUlomatic rcaponaes when once begun, arouses 
resistance and an unpleasant feeling-tone. This is illustrated in 
the well-known Downey tests for character traits in which the 
subject is asked to reduce, enlarge or otherwise alter the character 
of liis writing, and in which the measure is in terms of resistance 
encountered in complying with the instructions. Now, it is just 
this unpleasant feeling-tone which the advertiser tries In so many 
other ways to avoid, e.g. by the use of beautiful illustrations, 
beautiful color combinations, graceful border treatments, appro¬ 
priate type faces, etc. The coupon, if it is to be relied upon or 
used at all, should certainly nob be permitted to defeat its own pur¬ 
pose or the purpose of the whole advertisement by allotting too 
little space to it. 

This brief study points to three conclusions, namely, that the 
return coupon cannot adequately measure the effectiveness of an 
advertisement or n medium, except in direct mail selling, because 
of the complexity of factors on which reaction to it depends; that 
ns used at present it lacks sufficient attention-getting power to at¬ 
tract more than a amall portion of the readers of the advertise¬ 
ment; and that in tho size in which it most commonly appears it 
is likely to create an unpleasant feeling-tone because of inadequate 
space allowed for writing. 



FLUCTUATIONS IN MENTAL PRODUCTION WHEN 
MOTIVATION IS THE MAIN VARIABLE 

By F. B. llNuniT and II. IL RemMERS 

GAP BETWEEN POSSIBLE AND ACTUAL PRODUCTION 
IN COLLEGE STUDENTS 

No one knows with useful accuracy just how Ricat is the gc^p 
between the potential capacity of u oolleg-c student and his nc- 
compUshinent in college courses, There are, no doubt, many stu¬ 
dents who, if we make a rough use of Eraiizen's Accomplishment 
Quotient, possess 100 units of potential enpacity and whose ec- 
complishincnt in college work is apj)ropi'intely 100 units. These 
are efficient students, for there is a ncg-ligiblo gup between potent¬ 
ial power and mental production, On an invested capital of abil¬ 
ity the yield is satisfactory. 

There arc other students who possess say 100 units of capacity, 
but whose mental production is 80 units, or 70 units, or even prob¬ 
ably 50 units. These students do not do as much as they should 
when their ability to work is cnnsidcred. Wc might very well 
suppose that three students have 100 units of potential po^y(’r 
each, and one of the three tarns in 98 units of worlc; another 84; 
and the third 70 units. The second and third arc not then doing 
the amount or quality of work we can fairly expect hi the light 
of their potential capacity. They arc not doing mental work ef- 
fccLively. 

In our high schools we are rapidly gel:ting- oui* requirements for 
individual students on a scientific basis. Pupils witli approxi¬ 
mately equal mental ability must do approximate work. The same 
quantity or quality of work to be produced by throe pupils, say 
80 units in each case, is not estimated a “B” for all students ir¬ 
respective of their diffOTcnce of ability. A student with 120 units 
of ability who hands in 80 units production may be failed, whereas 
60 units of production by a student of 100 units of capacity would 
be judged as creditable work, and one of 80 units production with 
an 80-unit mind should receive definite commendation for his 
work/ 

The college instructor is a genuine teacher to the extent that the 
gap between potential power and actual accomplishment in each 

'0£ couusfe wo tlo not moan llLcniUy that Intellect noLMl ov even hUov\1i1 l^c 
Hi oil gilt of fia n collDcUoM of iinltH. Tills plirnse Is iisoil only lo iiinko pin In 
llinL (Ufforencos In lii(ollecL\iJil tiblllly, nnil the roliilloTi of tlipso (Ilffert’iicoH 
in coilogo work iH of linportnncc. Neither ciin we tlpscrlhe college work In 
loTins oii mills. U would ho ji clour gain If wu could. Tin* point is that 
the rcliitlve cllleluiicy of sliideiits’ work, tllffnreiiccH of inenUil nhllity 
counted In, Is bo tier thim consider a Lions of work dlfTorcncQ of mental ability 
UCffleetcd. 
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one of lus pupHa is small and tends to grow smaUci*. That wide 
gnus of this kind exist in most stiulcnts in the nverago college of 
liberal arts could probably bo neatly denionstratcd if time and 
money for s»ch a resonrch wore nvnilable. 

WHY THE GAP EXISTS 

The size of this difFcrcncG between what a student could do and 
wliftL he does do is n function of many factors, among which are 
undoubtedly, (u) the ii'iclevance of the subject mutter to the pur¬ 
poses of the student, (b) the successful competition of many extra¬ 
curricular activities, (c) the inadequate manipulation of the laws 
of lenniing by the teacher and the lilcc. 

Now the laws of learning or the laws of correct teaching operate 
as truly in the college classroom as they do in the primary school 
or the eighth grade. Lack of sound pedagogy in the classrooms of 
a university can not be defended on any grou?i(l. In fact there is 
a growing ronlization on the part of many that skili in leaching 
as teaching must be liiglily prized and honored by college admin¬ 
istrators. 

Instruction on 'TIow to TeaclF^ i-s being provided for the younger 
members of severnl iinivcrsiLy staffs already. 

DATA ON ATTENTION 

One of the necessary conditions of learning is attention of a 
high level on the part of the learners, It may be properly asked> 
^‘Wliat are Dig attention habits of college students?” 

The following data may be interpreted as very strongly sug¬ 
gesting that one reason for the gap between what could be done 
and what is done by college students is that the kind of attention 
(or lack of it) given by students in the college classroom hinders 
if it does nob innkc impossible, rapid or accurate learning, If in 
this simple chart, lino A means a very low degree of attention; 
line B means the kind of listless, passive attention that one gives 
to familiar surroimdinga while I’iding; line G represents a rapt 
attention, such as one gives to the reading of a telegram or to 
the tense crises in a foot-ball game we can see that the amount 

C 


B 


A 


of time spent in a recitation or lecture with attention of A type 
or B type is really but little more than lime out. The kind of 
learning required ,in college work takes place rarely if ever except 
when the matter in hand ia attacked with type G attention. What 
per cent of a 60-minute recitation is spent by a student giving 
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type C attention? Whafc per cent type B or type A? No ono 
knows, nnd of course the individual variations nve very wide indeed. 
A student does not know with accuracy the amount of time spent in 
the subject matter with these types of attention. His opimouj 
though, is probably better than a guess, On the whole ho is apt 
to report the matter with errors favorable rather than unfavorable 
for himself.” 

The writers selected groups of college juniors for study. The 
students were on the whole among the "better sort.*' Their opin¬ 
ions concerning the kind of attention actually paid in classroom 
work is reported in the follovring tables: 


6 

10 9 

16 8 

20 11 

26 a 

30 1 

36 7 

40 2 

46 1 

BO 4 

56 1 

60 I 

65 
70 
76 
80 
86 
90 


5 

1 10 

12 

2 9 

G 

1 6 

2 3 

1 1 

4 

12 

2 

9 

4 

5 

4 1 

3 

1 1 


TABLE I 

Distridution op Kinds op Attention in Per cent op Total 
Recitatidn Time for Cultural Courses, 

College op Lideral arts 


% 


A 

5 


B 


C 


A, B, and C refer to kind of attention ns defined in context; 
refers to % of average recitation. To be read five students thought 
5% of the recitation time involved type A attention; nine students 
thought 10% of the time involved type A attention, etc. 

These distributions give q spread of the type of attention Juniors 
give in the average recitation. The central tendencies are: (1) 
that high, effective attention, type C, is given lB%-20% of the 
time; (2) that a lower, less acute attention is given B5%-C0% of 
the time; (3) that between lB%-20% of the time practically no 

Ui’or d/ita on tlic unconscloiiR tcniloncy of ovcr-cstlmntloil Rce: Pltfnllfl 
ttntl Utitlng Schemes, Knlght-Prnnzon (Journul of Educallonnl UcRCfirch, 
JIay» 1022.1 
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attention is given nt all. Little lenming can go on when atten¬ 
tion of typo A or D is given. Obviously a central improvement in 
college inatruction would be to make those changea in class pro¬ 
cedure which would tend to cause n large percentage of recita¬ 
tion time to involve that type of attention which is essential to the 
learning process. 

When we have ft group of students in the college of commerce 
estimate the percentage of time in the recitation given to the three 
typea of attention, we get n slightly different result. The central 
tendency of the lowest kind of attention drops 5%. The middle 
BO-60 type of attention takes up about 50% of the time. The ef¬ 
fective type of attention ia the rule about 26% of the time, slightly 
higher than in orothodox cultural courses. These data are spread 
in Table 11. 


TABLE ir 



College 

OP Commerce 


% 

A 

B 

C 

6 

6 



10 

3 


3 

16 

3 

3 

2 

20 

n 

1 

1 

26 

2 

2 

9 

30 



4 

36 


1 

1 

40 

1 

1 

2 

46 


1 


60 


10 

2 

66 


2 


60 


3 

1 

65 


1 

2 

70 


2 

1 

80 




85 




90 




95 





When, however, we go over into the definitely vocational courses 
of law, medicine, and engineering, the opinion of the students as 
to the kind of attention paid in class is in startling variance with 
comparable opinion of students in the college of liberal arts. Data 
on 50 law students is spread on Table III. 


tile snmo fts Tfihia I. 
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TABLE in 
T,mv Collfqf. 


% A B 

6 21 15 

10 14 8 

16 G G 

20 4 3 

26 1 3 

30 0 2 

35 1 0 

40 1 

46 0 

BO 0 

55 2 


GO 

GB 

70 

75 

80 

86 

00 

95 


1 

0 

1 

2 

0 

2 

3 

4 
8 

15 

3 

1 


Summary of these data; The drift tawarrt effective attention 
habits is significantly paralleled by drift in curricula toward voca¬ 
tional content. This means, in the opinion of the, writers, nothing 
more or less than conscious motivation causes large fluctuations 
in mental production. 

A SECOND INVESTIGATION 
The above data are worthy of consideration despite the absence 
of objective measures of mental production. Wc now will de¬ 
scribe an experiment in which adequate objective dnta furlhcv 
support our contention. 

TUF. SUnJKCTS OF TIIF KXl'FRIMKNT 
The subjects of this experiment were ten college freshmen wlio 
had been subjected to a strenuous regime of humiliation and 
fatigue duty during their probation period as pledges of a fra¬ 
ternity.' A brief summary of this regimen is in order here. 

The first day of probation cqch one of the ten subjects was 
given a rather strong dose of physic (two Hin'kle's pills). They 
were not permitted to shave or bathe during the entire period of 
probation, A fake branding, very reaUstically carried through, 
which, according to the testimony of the chairman of the initiation 
committee was obviously n considerable mental shock, waa a part 
of the program. Each freshman had to carry with him wherever 
he went some rather weighty or bulky article as n brick, a pail, 
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fl piece of g-as-pipc, etc/ Besides these quantitatively rathei' up- 
nieasurnble indignities, which further included generous doses of 
f'paddiing'* with barrelstnves, the eating of raw liver (ostensibly 
dog-meat) sprinlclod with asafoeticla; the application of embar- 
rflssi/ig, rather liuniiJiating names to the pledges, etc., perhaps the 
more sign/fleant features from the point of view of this experi¬ 
ment arc that the men wei’c permitted to sleep only from one to 
two hours out of every twenty-four, find that during each of 
their twenty-two waking ho lira tliey were compelled to do menial 
or nonsensical tasks,about the house, or more frequently to go for 
long hikes of i2 to 15 miles, In addition to all this, they were 
required to attend to their regular university work. 

The probation period began on Monday, and the experiment to 
be described here wus carried out on the following Friday laLe at 
night, Here we have a group of workers, fatigued, harassed, and 
working at a time when the social cuatoms of a college campus 
make work unusually distasteful. Eagerness for entrance to 
the fraternity was ostensibly related to scores made during* 
this work period. Thus the cards were stacked against this group 
exedpt for moliyation. 

A few days later a group of 54 college juniors (mostly women) 
were given a similar but shorter test on the same material aa a 
means of securing coinpavablc data from "normal" individuals. 

Comparison of scores made on inLclligence tests showed no signi¬ 
ficant differences between the two groups. The juniors were 
worlcing under good conditions but with no special motivation. 
Thus the cards were .sLnckecl in their favor for no motivation 
other than those operating in a normal college recitation, 
MATOUIAL AA’D PIIOO^DUPK 01-" Till’: liVVKSTlGATION 

The materials used wore the Thorndike addition sheets,, each of 
which has forty-eight columns of ten addends -with I's and O's 
omit led, "Any successive five of the columns are of a diiTicuUy 
nearly, if not exactly equal/" These .sheets were arranged in pads. 
There was no possibility of the subject’s remembering t)ie answers, 
for there was no possibility of identifying the seven different 
kinds of sheets. 

Our handicapped but motivated grouii was told by a member 
of the fraternity that they were to as.sist in a scientific experi¬ 
ment and that they were to push themselves to the limit ns scores 
on the tests were involved in iinal election, Desire to qualify for 
the fraternity was the motivation. The attitude of the group as 
a whole was one of cordial co-operation. At the signal "Go!" 
they were to begin adding and to continue until a signal "Markl" 
was given. This was clone at the end of every five minute period, 

'SVe Giirtli, T.K., Mcntiil I'lKifrm*, Arelifvc'S of Psyeh. No. 41, Awgrast, 101S. 
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Twenty-four such fivc-iuinutc work periods were given with n ten- 
minute intermission nfc the end of the first twelve periods, at 
which time the subjects wore given light refreshments. The 
''Mark'' signal was for the purpose of getting an introspective 
check on the feeling-lone of the aubjecta na well as to measure 
progress by units oi time. They were told !□ murk A, B, C, D, E, 
or F, where A signified n feeling of gencrnl well-being, no nega¬ 
tive feeling-tone or discomfort; E was to be given the significance 
of intense Eiveraion or high negntivo feeling-tone; C wna to mean 
a rather neutral, don't-caie-oiic-wny-or-another ntlitucle, Durng 
the Inafc three periods tv strong eftort wtis made to obtain an end 
spurt by urging the men to put all they had in them into the work. 

AVERAGE AND INDIVIDUAL SCORES OF THE TEN TIRED 
FRESHMEN ADEQUATELY MOTIVATED 

The raw data give a composite work curve that is very nearly 
a straight line (See Figure 1) for both the total amount done nnd 
the amount correct. Nor is there any noteworthy fixlUng off in 
accuracy, The data from which this curve is constructed are 
shown in Table 1.® The last five-mi nuke period docs show a 
smaller per cent correct than do any of the other periods, but the 
difference is slight. The curve of the percentage correct is shown 
in Figure 1 at the top. The straight horizontal lino through the 
curve represents the arithmetic mean of the percentile values for 
each five-minute periodi Whatever decrease in total amount or 
amount correct occurred may be shown by comparing the work of 
the first 12 penods with that of the last 12. Table H gives the 
data for each person so compared na well as the totals for the 
entire 24 periods. The percentage of correct work for the first 
12 periods is 86, that for the Inst 12, 83 —a decrease of hut two 
per cent! 

The individual work curves arc shown in Fig. 2. Perhaps their 
most striking feature ia the consistent downward trend in the 
curve of satisfyingness and the lack of a significant correaponding 
downward trend in the output. The curve of satisfyingness^—in 
the case of every individual except Fitz—shows a marked de¬ 
cline with the progress of the experiment In his case the inter¬ 
mission for refreshments proved to be annoying rather than sat¬ 
isfying. 

'‘As tippenvs from tlio IntlJvIdunl work curve 2) aubjegt IJ—cftiiie 

lowr perlofla Ifilo. In oidc-r to cnlciilntc Jivcragcs tor the whole groupi his 
total output was Avelglited. wlLli lila (ivGtuge prodvictlon pov five-minute 
porloGn for the twenty porloda that lie acLuJilly worked. This procedure 
would Boem to be fair. U?ho ffonernl coiicliislong arc not In any ense (llf- 
itiTcnt timn they would huve been without Buch weighting. 
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TABLE I 

Showing the niiiount of work, tho ainoiint corrocL, Lhc {iinoimt 
incorrect, and the per cent correct for the ten fnishmcii in terms? 
of columns ntldccl per five-miniiLc period. 


Per cent 

Period Total Ain^t. Totul Correct Total Incorrect Correct 


1 

223 

188 

30 

84 

2 

237 

200 

31 

87 

3 

188 

158 

30 

84 

4 

20G 

170 

30 

80 

B 

217 

179 

38 

82 

G 

219 

194 

20 

89 

7 

218 

183 

35 

84 

8 

208 

175 

33 

84 

9 

223 

183 

40 

82 

10 

216 

181 

35 

84 

11 

18G 

160 

2G 

80 

12 

212 

17G 

30 

83 

13 

227 

189 

38 

83 

U 

240 

197 

43 

82 

15 

215 

188 

27 

87 

16 

194 

1G2 

32 

84 

17 

20B 

172 

33 

84 

18 

204 

184 

20 

90 

19 

207 

179 

28 

82 

20 

188 

162 

26 

80 

21 

191 

1B5 

30 

81 

22 

198 

167 

41 

90 

23 

200 

169 

31 

96 

24 

203 

157 

40 

77 

Av, per person 21.9 

17.8 

4.1 

Av. 84 
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TABLE ir 

Sho\ving' daLa for 10 ladividijald in terms of number of columns 
added. 


4-) 

u 

1 

M 

O 

U 

do 

3 

O 

6 

Cl 

Jh 

Mnirka Tod tea ting 
Fcollng-tono 

>n 

S 

d 

D Cl 




3 ^ 


Tl 

n 



1? 

'§ 

o 

frt 

O 

H 

a> o 
fkO 




h 


JJ 

U 

M/ 

iU 

il 

Fitz 

i636 

440 

82.09 

267 

205 

279 

235 

23 

1 





Po 

490 

429 

87.56 

247 

216 

243 

213 

5 

8 

3 

4 

3 

1 

Gi 

666 

603 

68.86 

329 

292 

237 

211 

7 

6 

4 

2 

3 

3 

Hnr 

636 

459 

86.63 

277 

233 

259 

226 

9 

3 

5 

7 



Bai 

362 

27G 

78.41 

182 

136 

170 

141 

13 

6 

3 

2 

1 


An 

B81 

478 

82.27 

282 

237 

299 

241 

13 

3 

2 

3 

3 


Gr 

513 

400 

89.90 

264 

236 

254 

230 

7 

6 

11 

1 



Ne 

705 

671 

80.99 

368 

300 

347 

271 

4 

14 

6 




Bo 

312 

229 

73.40 

150 

128 

162 

U)1 

2 

2 

6 

3 


8 

068464 

417 

89.87 

220 

200 

244 

217 

1 

6 

7 

2 

0 

3 

Av. 

600.0 

42G.e 

1 84. 

2BG.6 

218.2 

249.4 

208.8 

; 70 

51 

46 

24 

16 

16 


The curves show no wide divergcncea of amount correct from 
total amount done—they practically parallel each other from one 
fivG'minute period to the next throughout the experiment. 

The features of the work curve contended for by Kraepelin and 
his followers are not in evidence—^at least not consistently for all 
the individuals. There is little if any more fluctuation upward at 
the beginning* or at the end to indicate “Anlauf* or ‘^Schlusaan* 
trieb” than chance would account for. Subjects Pits —, Fo—, 
Dea—, Bai —, An— and Gr— show an increase both in amount 
done and amount correct from the first to the second period. Bo—, 
Ne— and Hav— on the other hand show a decrease, while Gi— 
does not change in total amount done. The toi'ininal spurt is no 
more in evidence, notwithstanding an effort to produce one by en¬ 
couraging and urging the men to increase their speed if possible. 
The amount done shows an upward trend for Fits—, Gi—»D g 5—; 
Ne—, Hav—, Bui—, Gr— mid Bo— however, exhibit a down¬ 
ward curve. Nor did the inter?nission cause any uniform change 
in output. 

Pig. 3 shows graphically in another way the relation between 
output and feeling tone. The curves were constructed by dividing 
the total number of A^s, B's, C's and so forth, into the number 


*The ran go o£ feeling Lone Indlcalcil by eacli ftubjcct Ih plottcil nt the 
rlgUt oC tUe grnpli, as ladlcnicd by the Xetters A, 13, C, J), 'R, P. 
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of columns marked by each, and plotting these results against tho 
letters on the abscissae. If feeling-tone correlated with output 
there should then be a consistent more or le.sg parallel downward 
trend for the two curves* Some of the curves—those for Bo^, 
DeS—, Hav—, Gr—, and Nc—, do show somewhat of a downward 
trend. Fo— and Bai— show practically no change; Gi—, however, 
increased markedly in output when hia feeling-tone was most neg¬ 
ative; this is also true to a somewiiat leas extent for An—. 

SUMMARY 

The experiment was carried on for 24 five-minute periods— 
that is, two working hours. The ten subjects had n total output 
of 5060 columns added, of which 42G8 or approximately 84 per 
cent were correct, The average total a mount added was approx¬ 
imately 21 columns per five-minute period per person; the aver¬ 
age amount correct per five-minute period per person was ap¬ 
proximately 18 columns. The range of individual achievement is 
from 40 columns attempted with 30 columns correct for subject 
Nel—, to ten attempts and two coluinna correct for subject Bo—, 
CONCLUSIONS^ 

1. A two-Kour work period, with this kind of material for in¬ 
dividuals who are already physically tired, is not sufTicient to 
decrease the output to any appreciable extent, 

2. There is little or no apparent relation between feeling-tone 
and amount of work done. 

3. There is no evidence of a wnrming-up period or of initial 
spurt. 

4. Accuracy is little affected, 

6. In spite of an effort to obtain nn end spurt, none was ob¬ 
tained. 

DATA OF FIFTY-FOUR TlESTED JUNIORS WITH ONLY 
CLASS-ROOM MOTIVATION 

The essential facts for this group are shown in Table III. The 
material used for the group was exactly like that used for the ten 
freshmen. Fig. 4 shows graphically the work curves for the group, 
both na to total amount and amount correct for each five-minute 
work period. There is little that ia noteworthy concerning these 
data except the very greatly reduced output as compared with the 
freshmen. Possibly this is to bo accounted for on the basis of 
class-room ^set* rather than on the ground of less ability in adding. 
There is nothing to warrant the assumption that the frcslmien ns 
a group were more skillful at this sort of thing by reason of 
previous training, The differential of motivation and mental at¬ 
titudes ia the explanation of the differences of an average of 21 

■'Those (Ifttii give liiBlglit Into certriln rispecta a£ “Moiitnl Fiitipuo.'' Wo 
are UHlug thom only to allow jimoiiiity of work na related to motivation. 
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eolumiia per five-minute period for the frcalimcn as ag’ninst an 
average of 11 for the juniorfli* 

The percentage correct for the juniors ia in general the same as 
fot the frcahmen. It will be observed, however, Lhut the dccrenae 
in nmount correct ia approximntely the anme for the juniora aa 
for the freshmen. There is no reason to believe that this decrease 
is due to fatigue; the test was given at 8:00 n. m,, tlic first hour 
of the academic day. 


TABLE III 

Data obtained from 64 college juniors in terms of number of 
columns added; 


Ist 6 min, 
2d 6 min. 
3rd 6 TT\in. 
4th 6 min. 
Bth B min. 
6th B min. 
7th 5 min, 
Av. 


fl 

a 

-M 

it, 

0 . a 

Kg 5 

a 

-Ir 

0 

w 

U 

4 J ^ 

•ill 

. 0 «1 


u 

M 0 

U OJ 


«J 0 

afl 

2t; 

u 


Jh 

«9 


41 QJ 

«H g 


HU 



OPk 

'flUPiPi 

998 

872 

87 

18 

4,18 

16 

843 

720 

84 

IG 

4.90 

IS 

002 

755 

85 

17 

6.46 

14 

SG8 

725 

82 

16 

4.92 

13 

836 

690 

83 

16 

4.9G 

13 

857 

710 

83 

16 

4.71 

13 

876 

726 

81 

16 

5.00 

13 

6178 

6198 

83.126 

16.3 


13.6 


a 

5g 

. w 

4J M 

V 4 U 

OPlH 


4.67 

5.25 


6.14 

B.06 

B.20 

4,96 

5.53 


CONCLUSION 

The above data support the followii^g assertion; The difference 
between a gemiinc motivation such as the freshmen had, and the 
kind of motivation v^ college class contains, ia a difference which 
not only olfsets extreme fatigue, but further oifsets freshman Da. 
junior ability, and in addition produces twice as much work per 
Unit of time with equal occurncy, 

juulora were just an onUnnry tcBcMnff group, n typical lonrulne' 
Bltuatiou, 



INFLUENCE OF MENTAL LEVEL IN THE 
FORMATION OF BOYS' GANGS' 


By M. LaVinia Warner, 
Ohio Univeraity 


It has been noticed that certain boys g^roup together; that a 
boy will have cor tain friends and not seem to have any other very 
close friends. There may be several circles of friends among the 
boys in a community and the circles will not intersect. 

This seema to indicate that there is a fundamental cause why 
certain groups of boys are found together and that it is not chance 
but some undorlying law that groups boys. The boys are brought 
together by churches, schools, and the like, but the churches and 
the schools do not classify them into the ditterent groups and gangs- 
Hence the question arises: Why are certain boya found in one 
gang and not found in some other gang? 

Dr. Charles B. Davenport in speaking of the mating of tho 
feeble-minded says, *'The meager social life, the customs of their 
parents, the natural ostracisms of the higher classes, and the in- 
dividuars preference for a congenial mate induces in marriage 
among the mentally deficient.'^ (2)* He found that the more fre¬ 
quent results of immigration of a feebleminded is his marriage 
into another defective strain in another part of the country, Altho 
in different localities, their social standards have been practically 
the Same, for social standards are determined by mentalities as 
weU as by experience, education and wealth. Consequently their 
social standards have been influenced mostly by mental level and 
inmarriagea of the defective strains have resulted, ''The social 
laws and natural preference of the individual is so powerful that 
like will consort with like even in outmarriage.'' (2) 

Dr. Davenport says, ‘'The law that like tends to marry like in¬ 
terferes mth the beneficient tendency (that the introduction of 
new blood would lead to better progeny) of outmating. The con¬ 
sorts selected from outside are frequently quite as defective as 
those who select them.'' (3) 

Miss Mina A. Sessions gives the same ideas of marriage selec¬ 
tion na those given by Dr. Davenport. Miss Sessions says, '‘The 
reason for so many cousin marriages are probably twofold. First 
in their own stock they find the most congenial companions, and 
second, they are largely forced to marry each other for the simple 
reason that no one else will marry them or have anything to do 

firtlcle Is a conOeiiscil form. Comitlote article miiy be to unci nt 
Ciinujgle tilbi'jiry, Ohio IJnlvorsiLy, Atiioiis, Ohio, and In Columbia [Jnlvcr- 
^^Uy Jjlbrary, Neiv city- 

'Numhers throughout this thesis refer to lilhliogrnpliy listed at the end. 
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with them. When they do marry outside the family, they marry 
some member of a weak strnin.” (10) These investipjations lead 
ua to believe that "Birds of n feather flock toj^cthcr," even in mar^ 
ringes of the feeble-minded. 

The same idea holds true in marriagc.s of tlio deaf. Dr. Poy 
says, "III no human relation is the truth of tlie proverbs, ^Birds of 
a feather Hock together’ and 'A fellow-feeling makes one wonder^ 
ous wiser more fully exemplified than in the friendships and mar¬ 
riages of the deaf." 

In his study of the divorces of the deaf, Dr. Pay found the pro¬ 
portion where both partners were deaf to lie 2.5 per cent and where 
one was deaf the other hearing, the proportion reported is C.4 per 
cent. Tliis shows that the matings were more .successful where 
both partners were deaf than in casc.s where one was n hearing 
person. The deaf partners wore more congenial than one of them 
could have been if he wei-e connected by hearing and spenking with 
those around him. (5) 

The deaf have a common mode of expression. This enables 
them to appreciate and enjoy one another. Each is more or less 
barred from the hearing folk and he is glad to have u comp anion 
similar to himself. Their deafness causes them to hove common 
experiences. It is the effect of their deafness that attracts and 
holds them in cornpanionship. 

Dr. Davenport and Miss Sessions determined for the feeble¬ 
minded and Dr. Fay determined for the deaf, that there are com¬ 
mon factors at work in bringing and holding together each of 
these respective types of people, This suggests that the sam* 
principle could be applied to other types, 

In order to make a study of the factors determining boys’ gangs, 
various groups of boys who have been brought into court and who 
were known to be close companions by court officials, social work¬ 
ers and school officers, have been investigated. The data was de¬ 
rived from school reports, court records, and the records filed by 
the Children's Service Bureau, Youngstown, Ohio. The social his¬ 
tories are the reports of investigations made by the bureau’s special 
social workers. The pyschological examinations were made by Dr. 
H, H. Young, director of the Children's Service Bureau and hia 
assistants in psycliology. 

Thirteen groups and seven pairs of boys were tabulated and 
sixty-six different individuals were included in the study. 

The ages in each group were computed to the date of crime com¬ 
mitted by that group, or if no particular date could be obtained, a 
given date was taken. So in each group both the chronological 
and the mental ages of each child arc given for the same date as 
that of his companion. 
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MENTAL LEVEL OF BOY^S GANGS 
REPHESENTATIVE CLUBS AND GROUPS 

TKE FRANKLIN CLUB 

A gronji of Lays traveling about the city doing many little things 
that were not to be favored, attracted the attention of court of¬ 
ficers and social workers. Those boys were well’equipped for vari¬ 
ous sorts of business that require no arrangements with the other 
party concerned. 

The gang had three horses and an old wagon. They drove 
about the city picking up bottles, rubber and the like and ''stealing 
oranges, bananas, whips, pop, beer, whiskey, cigarettes, copper, 
etc. 

When about nine years old, A. S. one membeif of the gang, told 
of cutting the windows at fl gun shop and how they were chased 
by a policeman, He snid that they were caught twice and that 
when caught they gave wrong names. He said that they generally 
drove the best horse so that they could make a better get-away. 
They got up nt two or three o’clock in the morning and "went out 
picking/' returning about five o'clock. 

A. S. gave naany instances which show that they are a real gang. 
Their environment lends them to do anti-social things and with 
their low mentalities, they do not always make a successful get¬ 
away, In all probability they are caught many more times than 
they would be if they were of higher mentalities, 

Their main work seems to have been stealing automobile parts 
from one party and selling them to another. In one case they 
would take the materials back and sell them to the "Jew" from 
whom they had stolen them. 

The gang wag first noticed in particular when they broke into 
a jewelry store window in order to steal some nickels that were on 
display in the window. The boys got the idea of cutting the glass 
from a picture show. The actor cut the glass with a glass cutter, 
then tapped it lightly until a smooth piece fell out, The boys had 
gotten some glass cutters from a twenty-five cent store the day be¬ 
fore. They had stolen some of the cutters and had bought some. 
They were not as successful as the actor on the screen, however, 
in cutting the glass. A policeman came along, arrested them and 
toolc them to the Detention Home, They were given a hearing in 
the Juvenile Court and the judge suspended sentence in each ease. 

A few days later a boys' worker formed this group of boys into 
a club, later called the Franklin Club. The boys' worker tried to 
interest them in athletics and games of various kinds. They were 
taken to the park on hikes and in every case their individual inter¬ 
ests were studied and appealed to as far as possible. 

For a period of a few weeks after these boys had been organized 
into the club, they seemed to be doing well, but they were soon 
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back to some of theii- former habits. About a mouth after their 
organization, some of them played truant and some one stole from a 
store in the community. Comparing their record of tlie past year 
with their behavior nl this time, little improvement was found. 
After working with these boys and not getting tho results which 
the boys' worker hoped to get, ho took them to the Children's 
Service Bureau for meutal examinations. 

The following table shows tho ago, mental age and I. Q. of each 
at the time of breaking the jewelry store window; 

TABLE I 

THE FPANKUN CLUD 
Chronological Age Mental Age 


Name 

Years 

Months 

Y'cars 

Months 

L Q. 

J. C. 

10 

0 

7 

10 

78 

J. F. 

11 

9 

7 

8 

65 

R. L. 

13 

2 

8 

1 

61 

F. P. 

11 

6 

7 

11 

69 

A, S. 

11 

0 

7 

2 

65 

S. V. 

13 

1 

0 

1 

09 


Table II gives the mean variation of the chronological ages to 
be eleven months and that of the mental ages to be only five 
months. 

TABLE II 

AVERAGE AND MEAN YARIATION 
Chronological Age Mental Age 
Years Months Years Months I. Q. 
Average 11 9 7 11 63 

Mean Variation OHO 6 4.1G 

Table I shows that the boy with the highest I. Q. is the youngest 
chronologically and that the boy with the lowe.st I, Q. is the oldest 
chronologically* The case of S. V, who ranks a year and more 
above the others in mental age, ia explained in Ms record which 
shows that he is slow and easily led by others. Dr. Young states 
that S. V. is incapable of making hia own decision. He is highly 
suggestible and is largely dependent upon hia immediate environ¬ 
ment and associates. His easy way and lack of will power is 
probably the cause of hia being led by lower mentalities. Taking 
the group as a whole, the tables show that the mental ages bear 
a close sameness. 

There are other gangs of boys in the neighborhood, but the 
Franklin boys arc not found with them- The Franklin boys at¬ 
tend regular public .schools, and this chance to meet other com¬ 
panions does not seem to affect their choice, Altho they come 
in contact with the higher boys, the duration of their eompaniou- 
ship is so short and non-social that no noticeable event lakes place. 
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No doubt, the mentally higher boys commit little crimes, but they 
bar from their comijany any one who is liable to expose them. 
Consequently the type of mind found in the Franklin dub has no 
place with the higher type child. Then the lower level boy would 
not be able to contribute to the success of the gang and being a 
iniaflt he would go where he could be nearer the top in action and 
where ho would he on an equal with his fellows. 

The public school .attendance department shows that in cases 
of truancy among the Franklin club, the boys were either alone 
or in company with another member of the club. However, the 
record of J. F. shows that he played truant three times with two 
other boys but their mental ages do not differ from P.'s more 
than six months and the I. Q.'s arc within the range of seven units, 
Court records show that boys from thia club have committed 
ten different Crimea in comptiny with one another, but there is no 
account of any one of them being arrested in company ^vith a boy 
who rates with normal mentality. Three boys from the Franklin 
club, however, have been in court with boys from other groups 
which arc included as subjects for this theme and in each case the 
other boys rate below an I. Q. of 69 and with a mental age not dif¬ 
fering a year and seven months from that of the Franklm boys, 
and within six months on the average. 

OnOUPS NUMBERED SEVEN, ELEVBJ^ AND THIRTEEN 
Of the boys examined in groui} seven, the one with the highest 
I>Q, is the youngest chronologically, and has the highest mental 
age. Altho the difference in mental age is greater than that in the 
Franklin club, yet the same tendency that like mental ages tend 
to group together is found here. 


TABLE III 
GROUP SEVEN 

Chronological Age Mental Age 


Name 

Years 

Months 

Years 

Months 

I. Q. 

C, B. 

15 

0 

10 

8 

71 

J. B. 

15 

8 

8 

6 

64 

J. A. 

16 

6 

No mental rating 


L B, A, 

13 

3 

No mental rating 


R. C. 

35 

6 

9 

4 

60 


C, B. and J, B, are vex-y close friends, C. B. being the follower 
and admirer of J, B. J. B. ia so low mentally that he will jump 
into any undertaking without fear of consequences and C. B, is 
low enough to follow the example, C. B. is not troublcsomely in¬ 
clined and he would probably cause society less trouble if it were 
not for his close companionship with J. B. Although C. B. is not 
so low mentally as J: B. yet because J. B. is older and larger and 
is able to do striking things, C. B. easily falls in line with all hia 
misdemeanors. 
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Dr, Young says, "Time and again t)irough the interview con¬ 
cerning C, B.’s past history, he referred to how much he thinlts 
fihout J. B, taking money* He seems to be much impressed and to 
think much about how J, B. takes money from his father. Tho 
repented reference to tliis together with the outline of what and 
how C* B. himself has stolen and what induced him to stonlp seems 
to indicate that he has ft dominating mental complex about J. B, 
and his stealing which with his low mentality is very largely, if 
not entirely the cause of his own stealing," 

The individual records of G* B* and J, B, arc very similar. Their 
histories of theft and night wanderings are practically the saino. 
It is not exactly an influence which J, B. has over C< B., but it is 
a kind of unconsciousness on J. B/s part and n thoughtless fob 
lowing on the part of C. B. 

J, A. and R, C, have also led C. B. to steal. J, A, was not given 
a mental examination, but his school record shows him to be re¬ 
tarded more than three years and he has a long court record and 
a boya^ industrial school record. His father reports that he can¬ 
not control him. 

J. B- A. had no mental rating either, but his school record shows 
poor attendance and the principal reports that J. B. A, is in one 
day and out for weeks, a?id that all his school work is a complete 
failure. He is pushed on in the grades and does not flt anywhere. 
He is three years retarded in all hia subjects. 

The histories df J. A. and J. B, A. nnd the mentol ratings of 
the other hoys show the group to be below normal and their mental¬ 
ities to be somewhat equal. As in the Franklin club we have no 
account of these boys chumming with mentally higher boys or 
boys of the normal type. 

J. B* and C- B. appear in Group Thirteen with A. S. a member of 
the Franklin club and with two other boys whose mentalities are 
undetermined^ but whose social standards are rated by social 
workers with those of their companions. Taking these boys as a 
group, we have a dilference in mental ages of two years and six 
months and a difference in chronological ages of three years and 
five months. All are so mentally equipped that they are able to 
enjoy the same things. Each ia in a group where like types me 
found. The I, Q.'s of these boys are below 71 and the I. Q-'s of 
their friends are below 78. 

In the study of Group Eleven, it wag found that the chronolog¬ 
ical ages are in an inverse ratio to the mental nges. 
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TABLE IV 


GROUP ELRVEW 

Choronolo^jicul A^c Mental Ag-c 


Name 

Years 

Months 

Years 

Months 

L Q. 

A. K. 

15 

I 

E 

10 

59 

S, J. 

13 

8 

9 

7 

70 

G, B. 

12 

7 

10 

8 

86 


The experience given the elder cliildrcn b/ living longer in the 
world Lends to place them on an equal basis Avitl\ the younger 
children who have higher rnenLnl nges. Consequently the expeii- 
ence on the one side and the experience and the higher mental 
ability on the other enable the boys to enjoy one another's com¬ 
pany. The inverse ratio is found in Table I also, but it is not 
emphasized there so much. In fact, this tendency is found in all 
the groups. 

Table V shows that with the exception of three groups and 
one pair, the I. Q. of tho youngest boy is greater than the I. Q. of 
the oldest boy. 


TABLE V 



onours op mowe than three boys 


Groups 

Oldest 

Youngest DifferencG 

1 

61 

78 

17 

2 

02 

09 

23 

Franklin 

61 

78 

17 

1 

54 

71 

17 

0 

72 

93 

21 

10 

68 

73 

16 


cnoupa OP three 


4 

62 

56 

e 

5 

80 

80 

0 

d 

66 

76 

17 

B 

92 

72 

20 

11 

69 

86 

26 

12 

68 

82 

24 

13 

54 

65 

11 



PAIRS 


14 

69 

72 

3 

15 

69 

66 

2G 

IG 

82 

93 

11 

17 

62 

72 

10 

18 

62 

72 

10 

19 

106 

70 

36 

20 

63 

100 

97 



Average difference 

16 
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This shows thnt older boys with mentalities below normal have 
a tendency to group with younger boys who hove a mental age 
near their own and slightly higher. The higher mentalities of 
the younger boys enable them to cope with the alder boys who have 
the experience ot living longer in the world. This illustrates hov/ 
TTiental equality exists in groups formed by natural selection anti 
indicates that mental nbilitics tend to go together. 

GROUP CONTAINING DOYS OP NORMAL MKNTAL AUILITY 
In three groups and in two pairs boys were found who rnnh 
with much higher intelligence than the other members of the 
groups. These conditions were explained when it was found that 
in each case, excepting one, the boy with the I, Q. much higher 
than the others wq.*; psychopathic, and he also had bad heredity 
which would influence his choice of society or would lower Ins 
standards of society. 

In one pair, the lower type boy was twelve years and one month 
old and mentally eight years and six months with an I, Q. of 70 
and the other was twelve years and eight months old and 
mentally thirteen years and four months with an I. Q. of 106. 
The mentally higher boy is an adopted child. Nothing is known 
of his father, The whereabouts of his mother is unknown. His 
mother left him at a Salvation Army Rescue Home wlieii he was 
two years old and never returned for him. The mother is reported 
to be a drinking and immoral woman, The foster mother says 
that the boy ia very bossy and ahvaya wants others to do as he 
wishes. His psychological record shows that “he does uot have 
the persistance to work out a task requiring careful decision and 
forethought, He \a psychopathic and impulsive to the extent that 
thru the path of least resistance he foils to use the intelligence 
which he has." The px’incipnl of the school where he attended 
reports that his work was extremely poor, his behavior was very 
queer and that he had “a mean disposition." His foster parents 
appealed to the court for a discijilinary school for the boy. They 
felt that he needed stricter discipline than they wanted to give 
him. 

The family of the mentally lower boy moved into the same house 
with these foster parents. The boys were not acquainted before 
this. The younger boy is one of those nice looking, talkative chaps 
who is in for everything and who will undertake anything. The 
father does not live at home and the mother is unable to control 
the child. The older boy not caring to “use the intelligence which 
he has'* would be glad to have anyone for a companion who would 
follow his suggestions and who would not be hampered by fear to 
do anything which might come up before the lads. The boys played 
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truant together several times' and once they ran off to another 
city together. 

In another case the boy who was rated as average njcntal ability 
was considered by his mental examiners na one who would be 
rc 2 (diiy influenced by his Associatesj that he would probably not 
Initiate much, but might readily become a follower. He is psycho¬ 
pathic. 

Another boy is much younger than the other boys in his group, 
but his mental age is about the same, lie is lacking in initiative 
and is somewhat iisychopathic in hiG responses. He is easily in^ 
/luenced and too readily submits to the wishes of others. 

The boy who is not psychopathic is considered a case of adoles¬ 
cent instability. Possibly Inter he will gro^v more stable and will 
seek other boys for companions. 

It would be interesting to continue the study of these boys to 
see if they still chum with the menially lower boys in a few years 
following, but it is impossible to do that in this research. 
JNFLUENCI5 OF NATIONALITY AND PROXIMITY 

A study wns made of tho nationalities represented in the differ¬ 
ent groups. Youngstown's greater population, about eighty per 
cent is foreign. In most of the groups there would be as many 
nationalities represented as there were cases, It was found that 
tho nationality did not enter in. If the boys were all Italians, it was 
because they lived and met in the same Italian district. 

Proximity and school e/Fecfced the meeting of most of the groups 
nnd pairs of boys. In a few instances the boys met in the down 
town section whore they sold papers or where they loitered around 
the cheap theatres. In one case the two boys lived on opposite 
sides of the cily. They met down town several times, became vei^y 
good friends and Hnally decided to steal enough money from their 
fathers to run away. In nine groups the boys of each group at¬ 
tended the same school, in ten groups the boys attended adjoining 
schools, and in one group three of the boys attended different 
schools found in the same quarter of the city and the other two 
boys in the group were the ones who lived on opposite side of the 
city. 

This division of these particular groups would not hold true so 
very long, however, because the school system often transfers the 
pupils from one school to another and sometimes n child is placed 
in a Parochial school for a term or two. In many cases the 
children living on the dividing line of two school districts may 
havo a better chance of getting acquainted than children attending 
the same school. The after school hours are not so closely super¬ 
vised as the school hours and the children may have more freedom 
in choosing their playmates. Even on the playground at school the 
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childi'Qa arc more or less held from freedom of choice by their 
school officers. Goirifj to and cominj? from school and the free 
hours afterwards give the best opportunity for natural aclcetioa 
of compnnioiis. During theso free hours the boys may wander 
where they like and they may play witl\ whom they choose, If 
they do not like one group of boys> they may piny nlono or go 
off with one or two others who enjoy the same things which they 
enjoy* 

VARIATIONS OF BOTH THE CHRONOLOGICAL AN THE 
MKKTAL AGES 

lu Table VI we find that the moan vuriatio nof the mental age 
is less than the mean variation of the chronological age in three 
out of five of the largest groups, that is the groups containing 
more than three boys. This shows that there is a tendency for 
less variation among the mcntnl ages than among the chronological 
agCB, 

TABLE VI 

MEAN VAIllATlON AND RATIO OF MEAN 
VARIATION TO AVERAGE 
Mean Valuation M. V, Average 

Chronological Mental Chronological Mental 


Group 

Age 

Age 

Age 

Age 

1 

13 months 

7 months 

.09 

.07 

2 

3 

15 

,02 

.13 

Franklin 

11 

5 

.08 

.05 

9 

17 

9 

.12 

.OB 

10 

16 

17 

,10 

.14 


Since the intelligence quotients are below 100, the mental nges 
are less than the chronological ages and arc expected to be nearer 
together. In order to determine further that mental age has more 
weight than chronological age in the formation of groups of boys, 
the ratio of the mean variation to the average (coefficient of varia¬ 
tion) in both the chronological and the mental ages was com- 
puted in tho larger groups and a comparison was made of their 
variability. It was found that the mental ages were less variable 
than the chronological ages in all bho groups excepting in Group 
Two and Group Ten. Sec Table VI. In these two groups the 
chronological ages were slightly less variable than the mental ages. 

The average of the mean variation of all the groups and pairs 
was found to be 10 months for the chronological ages and 11 
months for the mental ages. This includes the groups whose mean 
variation was higher for the mental age than for the chronological 
age and the pairs whose mean variations were not thought neces¬ 
sary to compute before because of the small number of boys in¬ 
cluded in each. The mean variation for the whole population (66) 
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ms found to bu 18 moubbij fov th« cbronolog-ical iige nnd IG'niontlia 
for the mental [i(?e. Thua we find: 

Chroiiolog^ical A^:c; Mental Age 


Average M. V* of Group 10 .Ofl 11 

--=. -=. .08 

M. V. of populution 18 16 

In some groups, Ibo ehronologio/il ages are qiiite similar. This 
is very marked in Grouj) Two. In this group, nil of the chronolog¬ 
ical ages are in the twelfth year. Tho mean variation of the 
inonLal ages is gronLor than the chronological agc.s of Group.s 
Four, 8oven, Ten and Twelve. 

Ill Group Seven, the chi'o no logical ages are very similar and the 
mean variation of the mental ages is greater as near as could be 
discovered. Two me in hors of this group have no mental rating so 
the moiin variation of tho menial ages could not be determined in 
exact terms for alt the inenihors in the group. 

The clironological ages of the two boys in Group Eight are 
nearer logetlier than their mental ages. Tim chronological ages of 
tiie other hoys in this group could not he found and they were 
not given a menial Leal, so they might alter this group in either 
(lircetion. There is very little dilfcroncG in the chronological ages 
ill the boy.s of Fbtir Fourteen and in Pair Nine teen, also. 

This shows thnl chronological ages might have some weight in 
the grouping of hoys, hut since there are more groups in which 
tlic mean variation of the mental ages is less than the mean varin* 
tion of the chronological agaa, we might conclude that there is a 
tendency for Die nieiital ages to have more weight in the formation 
of boy’s groups than chronological age. 

DISCUSSION 

Ill the Franklin Club the mean variation of the chronologiciU 
ages is twice as great as that of the mental ages. In this group, 
mental age must have affected the grouping. Common experience 
ontC'Z's into the grouping also. If one of the boys had lived until 
this time in a I'Ural district lie would not have enough experiences 
common to the other.s to fully appreciate the .'ittitudes of the other 
hoys altho their mental abilities are practically the same as his. 

Proximity influenced the grouping in most of the cases. It even 
had an in/luozice in the case of the boys living on opposite sides of 
the city. It was u common experience which brought them togethei' 
and it was their mental ages kept them together. If one of the 
boys Inid been menially high and the other menially low, their 
common experience of selling papers down town would scarcely 
have been noted- Common experience is the means of bringing the 
boys together and mental level is the determining factor which 
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continues to mnke Iheir experiences comynon. 

Experience, education, and social status liclp determine the 
choice of coxorndes ninone adiiUs of the same level aynl their social 
standards may di/Ter so that their tendencies mi glib be in an 
almost opposite direction, but aTnonjy "children the selections are 
less controlled. Children have more freedom in choosing their 
companions becanac they have not lived long enough to be in¬ 
fluenced in making their choice. Social standards, experience nne] 
education have not aiTocted them to so great an extent. 

The boys in these twenty groups wore not known to associate 
with boys who rank as normal, altho they Imd the same opportun¬ 
ity to get the same cxporicnco. Physically, their experiences were 
common, or could have been, hut mentally each type of mind in¬ 
terpreted the experience to suit its own level, 

In several groups, the oldest boy has the lowest I. Q. and the 
youngest boy has the highest I. Q,; that is, the I. Q. varies in¬ 
versely with the chronological age. This brings the mental ages 
to an equalized level. 

Boys of the same mental level can understand and appreciate 
the same things. They have reached the same degree of progress 
in the stage of mental development. Their minds are so equipped 
that they can appreciate the same situations, Consequently, each 
is at home with the other. No one is comfortable for a very long,, 
time if he is much inferior to those about him. He must hove a 
feeling of his own importance; that he has a place of his own 
in their society, or he will begin to shrink mentally away from 
them. On the other hand, if he can play his part on an equal 
basis with his companions, he will have a feeling of satisfaction 
and will be content to remain in their company. 

A hoy mentally high will not be satisfied with companions sev- 
'cral degrees below himself. They cannot reach his ideas and he 
will grow tired of being tied down to their level, so he will stand 
aloof or seek others for companionships, except in some cases 
where he takes a paternalistic attitude, and assumes a sort of 
guardianship or big brother attitude. 

A special class teacher reported that her two lowest children 
who were about seven years of age, would not have anything to 
do with one another. No doubt they were too young mentally 
bo be social. They were mentally below four years. The older 
and higher type of children in the class enjoyed leading these 
younger boys about and caring for them. They had the paternal¬ 
istic attitude and the younger children enjoyed the feeling of their 
protection. We enjoy being with leaders or individuals who arc 
iDur superiors because we feel that we arc being benefited by their 
presence. They cause us to live in an ideal state which we enjoy. 
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The low type child enjoys the company of the older children he- 
cause he likes to have them do things for him. He is taking a 
babyish attitude. 

This is not an attempt to solve the problem of group compan¬ 
ionship in so brief a study of so few cases, but the investigation 
indicates that mental age is the greatest factor in the selection of 
one's companion.'! and in holding groups together. It indicates 
that a common mental level with similar experiences as a back¬ 
ground is a much stronger factor in group formation then any 
other factors investigated. 
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LEGIBILITY OF BODONI, BASKERVILLE ROMAN, 
AND CHELTENHAM TYPE FACES 


By Hahold E. Buiirr ami Oohynk Dascjt 
Oliio State Uiiivorsity 


INTRODUCTION 

The iinportauce of type Icgihility for advertiaiuR or (general 
road nig needs no cominont. The ouLsUndiiig variables condition¬ 
ing legibility are size, case and face. The present alvnly is con¬ 
cerned primarily ^vitlt the last of these and is confined to an 
intensive investigation of three common typo faces. 

There arc five methods (as far ns the writers are aware), for 
monsuring legibility: maximum distiniee at which type can be 
read, time taken to read a passage, number of letters read in a 
tachistoscopc or minimum exposure nt which they can be rend, 
minimnm illnminaiion under which typo enn bo seen nnil extent 
to which letters can be thrown out of focus and still he identifiecL 
The first two of these methods have been tlie ones most frequently 
used. The present study used the last of the five methods mciv 
tioned. 

The most extensive study of type faces is that of RocthLcin.^ 

She presented a page of 28 letters at a dintauce beyond the 
limits of legibility nncl then advanced it toward the observer by 
20 cm, increments, recordini? at each stage Llic letters that could 
be identified. This method wade it possible bo uccumulate a I urge 
amount of data in a reasonable time and n considerable number 
of different faces were studied. CheUenliam, however, was the 
only onfi which she used that wsvs involved in the present study 
so no comparison is pos.sible, 

Roethlein found that legibility depended on form, size and 
heaviness of the letters and on the margin, position in group 
and on the shape and size of adjacent letters. 

Scott* found that a longer time waa taken to read a light-faced 
type than to rend a heavy-faced type, 

Adams^ performed an experiment on speed of rending a series 
of advertisements set in a wide variety of type arrangements. 
The material was too compUeated to throw much light on tho 
specific problem of type face. 

The present study tried to abstract from all variables except 
type fncG. Individual letters were used, all of the same size. 

‘lluL'llili'Ui. Ih AV. The krlatfre liCifihiUty fj/ hmeecul t'ftres af 
Tyi*<‘Ss Amor. J, ul LNyck. ItJlli, 2^1, l-rui. 

'C’f. Uol Hub wo nil, II. L. AftrcetlRin(f fi\uJ iSV7a‘»f/, p. 7M. 

•'AdiuttK, U. l\ Pv \}, 'Jll, 
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MATERIAL 

Three type faces were used in the experiment—Bodoni, Baskcr- 
ville Roman, and Cheltenham Medium. These were used in both 
upper and lower cases. All the letters were lour toon point so 
that the sixo variable was constant except in so fnr ns the upper 
case letters often occupied greater area than the corresponding 
lower case of the same point. The letters were cut from sample 
booklets of the American Type Founders Company, 

Each letter was centered individually on white unglazed card¬ 
board Gx6 inches for exposure. It was impossible to get a com¬ 
plete alphabet in all the faces and cases. Consequently, the re¬ 
sults considered below wore based on all the letters of the alphabet 
with the exception of J, K, L, Q, U, X, Y, Z, Several of these 
letters arc rather infrequently used anyway. The remaining 
eighteen letters in the three faces and two cases make one hun¬ 
dred and eight letters involved in the inve.stigation. Some other 
letters were included but the results not considered. 

The material was prosented in a Focal Variator.' This ap¬ 
paratus comprises an exposure field about G inches square illumi¬ 
nated by daylight lamps inside a hood. The material exposed is 
projected through a stationary'Convex lens which contro's its .size 
and then through two similar lenses which are arrang-ed to move 
reciprocally so that the focal point of the image may bo clianged 
without altering the size. The material ia projected through this 
differential system upon a stationary ground glass so that as the 
lenses move the image on the glass goes in and out of focus. The 
subject sitting with his forehead in a head-rest fifteen inches from 
the ground glass observes the images, In the present experiment 
a quarter-inch diaphragm wag placed on the lens next the ground 
glass to lesson the marginal glare. This was desirable because of 
the small size of the letters used but did not affect the focus. 

The differential lens system was controlled by turning a small 
crank. This crank actuated a screw 16 threads to the inch so that 
for each revolution an indicator moved l-16th of an inch on a 
linear scale. The crank was also attached to a small wheel with 
its margin graduated into 100ths so that it was possible to make 
readings to 1-100 of 1-lG of an inch. 

The data will be presented in terms of these scale readings. 
However, it is possible to convert such readings into terms of the 
position at which the image is actually in focus. 

The apparatus was set during the experiment so that at zero 
scale reading the image was perfectly in focus on the ground glass. 
The callibration curve was obtained by movin gthc ground glass 
toward the lenses by increments of one inch and at each point 
^WelKN, A- 1», TJie Vocal Vuriaior, Jonrniil (if KxiJtjrliiiuiUal I’aycliolujjy” 

ini7. 2. 100-llH. 
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determining- the scale reading when the image was in perfect focus. 
These determinations were made by coming in botli directions from 
illegibility until a leUev showed no appreciable increase in dear¬ 
ness and continuing until it began lo decrease in clearness. These 
four scale readings were averaged- This iiroceduro was followed 
with five typical letters at each point and with two observers, 
Scale readings were plotted against distance of the focal point 
from the exposure field. The curve is practically n straight lino 
whose equation by least squares is 2.09x-.64y+26.85—0 x repre¬ 
sents scale reading, and y represents distance of focal point from 
the exposure field. 

METHOD 

The experiment was conducted in a dark room. During an actual 
trial there was no illumination except the lights in the hood and 
a small heavily shaded light near the scale. Between trials there 
was practically no change in the illumination so that the subject 
was substantially adapted throughout to the ground glass field, 

Prior to each trial the lenses were turned to a point previously 
determined where all the letters were invisible. A letter was then 
placed on the field at the back of the hood, At the signal 
the observer placed his forehead on the bead rest and fixated the 
center of the ground glass. The experimenter then turned the 
crank at the rate of one revolution in four seconds, keeping lime 
with a inefcronome. The observer named the letter ns soon as be 
recognized it. If his response was correct the experimenter re¬ 
leased the handle immediately and recorded the reading. If the 
response was incorrect, the experimentGr said "No” and continued 
turning the crank until the correct response was given. The in¬ 
correct response \Yas, of couvse, subsequently recorded. 

The letters were given in a random order with all the cases and 
faces inter-mixed. Each subject worked for two sittings and in 
some cases three, in order to complete the entire series. The 
subjects were frequently a.sked if they were fatigued and there was 
considerable opportunity for rest between trials while the ex¬ 
perimenter was recording results and changing material. 

The subjects were seven students taking a laboratory course in 
psychology. None of them had had experimental training other 
than that which they had received in the course. There were five 
males and two females, Five of the seven had previously per¬ 
formed a simple experiment with a Focal Variator themselves. 
The vision of all was 20-20 or corrected to that by glasses, 

RESULTS 

The outstanding differences between the three families of letters 
are shown in Table I. The first column gives the observer, the 
second the average reading of that observer for the eighteen letters 
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in Bodoni upper case. The next column, the readings for Bodoni 
lower case^ and so on. For example observer number one gave an 
average scale reading for the eighteen letters in upper case Bodoni 

TABLE I 


A^VEnyiGE LEGIBILITY OP 18 LETTERS 


Observer 

Bodoni 

Baskerville 

Cheltenham 


u. a 

L. a 

u. c. 

L. C. 

u. c. 

L.C 

I 

14.7 

11.4 

14.0 

12.8 

17.6 

13.1 

II 

12.0 

10.9 

13.6 

12.0 

16.4 

12.0 

ni 

12.9 

10.9 

16.5 

10.9 

17,9 

13.4 

IV 

12.2' 

10.7 

13.1 

10.7 

14.4 

12.0 

V 

13.6 

11,2 

16.6 

12.6 

17,4 

13.2 

vr 

12.7 

11.8 

15.6 

12.4 

17.6 

13.6 

VII 

13.9 

11,0 

16.8 

11.9 

17.5 

13.3 

Average 

13.3 

11.1 

14.9 

11.9 

17.0 

13.1 


of 14.7 16ths of an inch. His corresponding reading for Bodoni 
lower case was 11,4. For Baskerville upper case 14.6 and so on. 
THg bottom row in the table gives the average for the seven ob¬ 
servers. The same results are shown graphically in Figure 1, 

The abscissa of the curve represents the three faces indicated 
while the ordinate represents the scale readings. Each observer is 
indicated by a different type of curve with the heavy curve giving 
the averages. The nine curve.*? nearest the bottom of the chart 
indicate lower case and the others upper case. 

The general tendency of results is obvious. Cheltenham is more 
legible than Baskerville. Baskerville in turn is more legible than 
Bodoni, The results are more marked with the upper case letters. 
It may be noted incidentally that throughout the upper case is 
more legible than the corresponding lower case. It should be 
borne in mind, however, that we are here dealing with individual 
letter.'? whereas it is well known that entire words printed in lower 
case are more legible than the same words printed in upper case. 
The results are presented from the standpoint of probable error 
in Table IL 
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TABLE H 


ftATlO OF 

DU'PKaENCB TO 

rnOBAULK 

Kiinou OF 

mFFEflRNCE 

Ob.sDi’Vcr 

Bodoni 


Bodoni 

Baskervillc 


Baskervillo 

CheUcnhnni 

Cheltenham 


U. C 

L. C 

U. C. 

L, C. 

U. C, 

L.C 

r 

0.2 

2,2 

4.8 

2.8 

5.8 

0.4 

II 

1.4 

2.2 

C,1 

(hO 

4.1 

1.7 

III 

5.2 

0 

8.6 

. 3.3 

1.9 

3.2 

IV 

2.3 

0.2 

4.8 

3.4 

2.B 

3.G 

V 

3.4 

2.7 

7.0 

4.1 

3.2 

1.3 

VI 

5.0 

1.3 

8.1 

3.3 

3.8 

2.3 

vir 

4.8 

1.0 

8.3 

5.8 

4.3 

2.8 

Average 

3.2 

1.5 

6.9 

3.8 

3.7 

2.2 

All cases 

7.2 

3.0 

16.9 

0,5 

8.B 

4.4 


This table gives the ratio of ililTerencc to probable error of dif¬ 
ference for the vai’Jous comparisons niul subjects indicated. For 
example, with subject [ the dilTcrencc beLween the average of 
Bocloni upper case and Llie avcraftc of Baskervillo upper case is 
0.2 tlie probable error of difl-’crcnco, while for those two faces in 
lower case the di(fereace is 2,2 the probable error. The figures 
for the seven subjects in each column are averaged in the row 
marked “average." The probable errors were also coin])iiiGd for 
all the letters of a given face and case for all the observers, i, e., 
120 (18x7) readings. The di/Terences between the averages at 
the bottom of Table I may be thus evaluated and in Table II the 
row "all cases,” gives the ratios of these difTcvcuces to the prob¬ 
able cvvoYs of dvlfevence. 

The tabic indicates that the difTovence between Bocloni and 
Cheltenham upper ease is uii<]uestioiiably significant, ns the 
smallest individual subject's difference is ^i.8 P. E. The differ¬ 
ences between Baskervillo and Cheltenham are not ns marked but 
some of the individual differences are significant and the average 
difference undoubtedly so. The differences between Bodoni and 
Buskerville upper case are of about the same order although not 
quite AS large. With the lower case letters the relations are much 
the same as with the upper case but all the differences are some¬ 
what smaller from the standpoint of probable error. The differ¬ 
ence between Bodoni and Cheltenham is the most marked, that 
between Baskerville and Cheltenham somewhat less, while that 
between Bodoni and Baskerville lower case is of somewhat doubt¬ 
ful significance. 

These results seem plausible from analysis of the characteristics 
of the three families. Cheltenham involves relatively heavy strokes 
of fnirly uniform width, Bodoni on the other hand, involves many 
light strokes and this is espcciciUy marked with upper case letters. 
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Baskerville likewise involves light strokes though not ns light as 
Bodoni, This corresponds to its intermediate position in legibility, 
In addition to the difYcrences between the families established on 
the basis of the average of 18 letters, there may be points of inter¬ 
est in considering individual letters in the various faces. Table III 
presents data from this standpoint. Each entry in the table rep- 


resents the 

average 

of the 

seven subjects for the 

letter 

and face 

indicated. 

Bodoni 

Bodoni 

TABLE in. 
Bftskev- 
villc 

Basker- 

ville 

Chelt¬ 

enham 

Chelt- 

enham 

Letter 

u. a 

L. C, 

V, C. 

L. C. 

U.C. 

L. C. 

A 

i3:i 

9.6 

13.9 

9.9 

16.9 

12.4 

B 

12.7 

13.0 

14-1 

15.2 

IB.l 

14.9 

C 

14,1 

10,7 

15.8 

1L4 

18.3 

13.2 

D 

14.0 

12.3 

16.3 

12.6 

18.2 

14.6 

B 

12.7 

9.4 

13.1 

10.5 

16.2 

12.2 

P 

11.2 

11.6 

14.2 

12.1 

1G.4 

10.6 

G 

13,7 

10.9 

1G.6 

9.9 

18.2 

10,1 

H 

14.2 

12.6 

16.6 

13.3 

17.1 

14.7 

I 

12.8 

10.0 

12.2 

13.6 

13.1 

13.5 

M 

13.7 

13.7 

16.0 

11.9 

17.2 

16.8 

N 

11.8 

9.7 

16.9 

11.0 

17,0 

11.9 

0 

15.8 

12.& 

17.0 

12.7 

20.2 

14.5 

P 

14.4 

13.5 

14.8 

14.1 

17.8 

16.4 

R 

13.0 

11.1 

14.1 

11,5 

16.6 

10.6 

S 

13.6 

8.6 

12.9 

10.3 

15.3 

11.6 

T 

11.7 

9.1 

14.1 

9.6 

16.6 

11.0 

V 

12.2 

10.9 

14.0 

11.9 

18.1 

13,2 

w 

13.3 

11.4 

17.1 

13.4 

17,9 

14.8 

Av. 

13.2 

11.1 

14.9 

11.9 

16.9 

13,0 


Obvioualy the legibility differences vary with the letters. The 
safest way to consider the matter is in terms of probable error. 
This was computed for any differences between means of the same 
letter in different faces that seemed of possible significance. 

The differences between lower case Bodoni and Cheltenham are 
most pronounced with the following letters and the differences are 
all greater than 4.5 the probable error. S, I, V, C, A, E, W- 
Most of these letters involve a considerable portion of light strokes 
which in the Bodoni are of course very light. With lower case 
Basherville and Cheltenham the ratio is 7.2 for A and 4.4 for C, 
with all the others less than this. With Bodoni and Baskerville 
lower case the ratio for I is 8,Q but the next smaller is 3,7 for P. 
The most noticeable fact regarding the lower case letters is per¬ 
haps the inferiority of Bodoni or Basketvillc A to Cheltenlmm A. 
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This letter has three light horizontal strokes. 

With the upper case the differences are relatively greater. For 
Bodoni vs. Cheltenham they are significant for practically all 
letters, but most marked in the case of V, N, B and 0. With 
Baskerville and Cheltenham, V, E, P, S and R, all have differences 
greater than 4.5 P. E. AViLh Bodoni and Baskerville the ratio for 
N, G and B are greater than 4.6, One noticeable thing is the 
poor showing of Bodoni N. It comprises two very light vertical 
strokes. 

Another method of approach is to consider each letter^s legL 
bility relative to the others of the same face and case. This 
could be taccomplished by ranking the values in each column of 
Table III. The greatest discrepancies between an upper case 
letter's rank in different faces are as follows; N has relatively 
low legibility in Bodoni compared with Baskerville, This fact 
has been noted above: S however ranks much higher in Bodoni 
than in Baskerville, V stands high in Cheltenham but low in the 
other two- With lower case letters the following discrepancies are 
large, Baskerville I is relatively high in legibility nnd Bodoni I 
relatively low, Bodoni P is relatively high and Cheltenham F, 
relatively low. Cheltenham and Bodoni M are the most legible 
in three faces while Baskerville is only average. 

general there is a somewhat closer correspondence in the 
relative legibility of the letters in the three faces with lower 
case than with upper case. Correlations wore computed (rank 
differences squared) between the different columns of Table III. 
For the upper case the correlations are; BondonUBaskevville >47, 
Bodoni-Cheltenham .74, Baskerville-Cheltenham .63, For the lower 
case the corresponding figures are .73, ,70, and .73, indicating 
closer corrGsipondence in the case of the lower case letters. It 
would seem that upper case letters afford a better opportunity 
for face differences in legibility to manifest themselves, 

A record was kept of all cases in which a letter was mistaken 
for another. These were tabulated to sho^Y any common ten¬ 
dencies. No error was considered of interest unless made by at 
least two subjects. The following confusions occurred in all three 
faces: lower case E read C; lower case H read B; upper case I 
read L; upper case R road K. The following confusions occurred 
in two faces, lower case; F road I, T read I; and the following in 
two faces, upper case: B read G; M read W; B read F. There 
was nothing in the analysis of results from this standpoint to 
clearly indicate differences in face. 

SUMMARY 

A study was made of the comparative legibility of Bodoni, Baa- 
kerville Roman and Cheltenham Medium type faces. The legibility 
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of individual letters was determined separately using iippei aiul 
lower case and f^^wvteen point. The Ict-ters wev^ pYesented in 
a focal variator and Evaluated in berms of the distance they could 
be thrown out of focus (maintaining constant size) and still be 
rocognizcil 

Greatest legibility was found on the average for Cheltenham^ 
followed by Bnstovillc, with Bodoni the least legible. This was 
tTUc for both nppev case and lower case but the dilTGreneea were 
more striding from the standpoint of probable error with tlie 
upper case. These differences seem plausible upon examination 
of the three faces, particularly with refenfence to tho width of 
strobes. Study of individual letters showed a tendency foi' the 
greatest differences between faces to occur with letters involving 
light strokes, inasmuch as these are particularly light in the 
Bodoni and Baskerville. 



A COMBINATION MENTAL TEST FOR CLINICAL- 

USE 


By Grace H. Kent 

Woi’CGslcr State Hospital, Wovceater, Mass* 

I. LIMITATIONS OF STANDARD TE»STS» FOR DIAGNOSTIC 

PURPOSES. 


The servioe^bilily o£ mental tests for tentative classification of 
large groups of persons 1ms been established beyond reasonable 
doubt and there are many tests in common use, both individual 
and group, which are sufTiciently accurate for such purposes as 
classiricalion of army recruits, school children, or factory em¬ 
ployees. But in the clinic no mechanically applied test should bo 
expected to take the place of patient and painstaking individual 
study. Used as an instriiinont for such study the standard teat 
may be a valuable aid; but it is of questionable value if we accept 
the findings as final and thus make it serve as a substitute for 
cnvefiil observation, 

The concept '*mental age" is an exceedingly convenient one and 
it i-s not unnatural that a servant so obliging should be expected 
to work over-time. Because the mental ago can be so easily stated, 
it is almost inevitable that it.s significance should be exaggerated, 
Thii.s we find a tendency to speak of a child's mental age as if it 
were as definitely and finally determinable as his life age and there 
is dansi'cv ihid the quidiletive fimhi7g:3 oi the tejt—which may he 
vastly move significant than any results that can be stated in fig¬ 
ures—will bo wholly overlool:ed. 

An unavoidable source of error in the use of a norm is that it is 
impossible to give due recognition to the variations in the indi¬ 
vidual records from which the norm is constructed, The norm may 
be derived from a sufiiciently large number of representative per¬ 
sons, but the individual variations still remain and the limits of 
possible normality lie close to the extremes rather than near the 
average or median.' 

'1 lUiMld giMUy In IfU* JkKun' in givu tfiip wniglil (o (Ilfs iiicior. In tliR 
inh'rijri'liilloii oV Iho iIiUjl wliit'li ilui IhisIh of tlio Keiit-llosnnoft 

iiKHORliUlim U*sl, imhlisiiL'd in ISHO, 1 miis «o Iniiircssutl l)y tlic tltJTct-- 

I'liui's wliU'h Llin losl liulifiiU-il normal unil Insiino MiOJccts Unit I 

illd ndl I’nlly int)H’Pcluli‘ llir iiiinorlJiiiuL' of llii* sliullarHlu.s Unis Jiidii'iiteil, 
'fill' nf •“JarjlvJfJiinJ for jiorniiil unUjorLH W’WH scvoii 

per coiil of all mid Ions, and llic nvonit'o Tor liisiuu' shIjJocIh wwa tivunLy- 
scviiii iiiT re III. 'I'lils is olivImKlv' o slguilli’iinl (UlTd’L'iicp, hut wo ciniiiot 
di'lf‘rmliio wlinl it slKniOi's for ii Vivrn hidlvldiial. The* riuii^o of varlnLloiL 
was vorv wlflo for htUli classi’s ol siihJoL’ls, In'iiit;: from zoro lo nlniMy ptir 
ri'iii fovTliP aoriiial Mihjrrls anil Jnun 11 vo lo nliirly-sovrii imr foiiL for Uio 
iiiHuiii' siihji'ds. 'I’iuMT' as IIiU'' .ni oivrliiriJtioofiUn^' lo t'lgjity-llvt' 
])PT coiil hi'lwL'di liulividiiiils i*r Uic hv<»* cliissi'Sj iiihI n i^* pliUn that no- 
i‘oiiL'lu,sioii.s slioiiiil ))(* (li'iiwn iilioal iiiiy iiHllvlihiiil on Iho laisis of a loiiL 
V lUch yli'Iils Biu'h v'lirlahla rosulls. 
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Another source of error which shonUl ho kept in mind is the 
personal equation of the examiner* Thia factor is well eliminated 
in many group tests by reducing the adminiatrntiou of the tests and 
the scoring of results to a purely mechanical process* But it cunnot 
be so Gtasily overcome in individual tests because much depends 
upon the inflection with which the examiner rends a question, and 
upon the spirit and interest with which he presents a problem. 
The test may be so fatiguing to the-exominer that he is unable in 
the latter part of the working day to do full justice cither to the 
•test or the subject. And in spite of the scoring cards and minute 
instructions which add more to the difficulty than to the accuracy 
of scoring, there remains considerable room for differ cnee of opin¬ 
ion, especially in tests calling for involved verbal responses. 

In order to be valid for adult subjects a test should be based in 
part upon faculties that develop with increasing maturity and 
'experienco as opposed to those faculties that ronch their zenith 
during the high school period and fall into disuse after school life 
is completed. If we are to depend largely upon tests for diagnosis, 
we should have a test that would show in what way a deficient man 
having a '^mental age'' of nine years differs from a normal boy of 
nine. We know that the man lacks the developmental possibilities 
which constitute the boy's chief asset to society. We know also 
that the man, by reason of his longer experience and more settled 
habits, can do many things which the boy cannot do. We indicate 
the man's inferiority to the boy by assigning an intelligenco quo¬ 
tient of fifty-six j but our criteria for determining his intellectual 
status are not adequate unless wc can show also in what ways he 
is superior to the boy. Determination of the mental ability which 
fs measured by the Binet scale, call it what wc please, does not tell 
us what we need most to know about a clinical subject- The man of 
thirty who gives a nine-year mental rating may be a useful and 
trustworthy laborer, or he may be a serious menace to society. 
Two thirty-year men of nine-year mentality, equally free from de¬ 
linquent tendencies, may differ very widely in their capacity for 
work, in their adaptability to different kinds of work, and in the 
amount of supex'vision required. The fact that they give the same 
mental rating is relatively unimportant since the proper disposal 
of their cases depends upon distinctions which are not shown by 
the test. 

It is difficult to over-state the possible errors involved in the use 
of a verbal test for subjects who do not understand the language 
in which the test is given. It is true, under certain conditions, that 
.a child's ability to acquire language may furnish a fair index to his 
intelligence, but we cannot make this assumption in a given case 
Tunless we know that the subject has had adequate opportunity to 
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acquire the langiing^e, I recently tested many children in a mill 
village of -which the foreign population is in the majority. The 
children use their own language at play, even on the school grounds, 
and many of them have rarely heard a word of English outside of 
the school room. To assign a mental age based on such showing as 
they can make in a verbal test would seem little short of perj’ury. 
Performance tests are useful in such cases, but more for qualita¬ 
tive interpretation than for mental rating. 

A test stands on its own merits, regardless of norms, since the 
findings obtained by an unstandardized teat that is well suited to 
the subj'ect are more significant than a mental rating derived from 
an ill-adapted test. Dr. Walter E- Fernald's questions on “Prac¬ 
tical knowledge” possess certain advantages over any standard¬ 
ized test known to me. Although they cover a wide range of 
difficulty, these questions can be asked casually and answered 
simply, usually in a very few words. They relate largely to mat¬ 
ters of local interest, and the child may easily assume that the 
examiner is seeking information on the matter inquired about. 
There is no definite programme for asking the questions, as for 
administering a more formal test, so the examiner is free to omit 
any question which does not lit the case and which might make the 
subject feel strained and unnatural. I should like to see these 
questions standardized, but not unless it could be done without de¬ 
stroying the elasticity of the system. For although a norm is a 
great convenience to the examiner, it is not essential to the serv¬ 
iceability of the teat. The age value represented by a given question 
or task is empirical, not absolute, and the examiner^a own experi¬ 
ence ought not to be wholly at a discount. When a test—even a 
standard test—is used by an experienced observer, I question the 
advantage of rigid adherence to rules. 

No test can be considered valid except on the assumption that 
the subject answers each question as well as he can. But it fre¬ 
quently happens that a subject who is brought to the clinic for 
examination comes very unwillingly and with no intention of giving 
any information about himself. The tactful examiner can usually 
obtain some measure of responaiveness, but it ia itnpoaaible to state 
the'exact degree of co-operation received. The lack of co-operation 
cannot be estimated in quantitative terms, while its effect on the 
mental rating is invariably quantitative. 

Among insane subjects one meets with all possible degrees of 
co-operntion. Some patients put forth their maximal effort in the 
hope of proving their fitness for life in society, some offer violent 
resistance, and some give no response at all. There are many cases 
in which the qualitative findings are of considerable interest, but 
it is exceptional to find a patient for whom the mental rating, as 
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such, liLis any significance even as n matter of record, still less for 
diagnosis or treatment. When the rating is high enough to ex¬ 
clude mental deAciency, this diagnosis is almost certain to be 
excluded also on other grounds* A low rating may indicate defi¬ 
ciency, doterioration, or poor co-operation. Extremely wide scat¬ 
tering of success and failure i.s usually associated with n psychotic 
condition, but it may indicate merely Lhnt some of the problems 
presented are interesting enough to command the co-operation of 
the subject while others nro beneath his notice, 

The examiner who administers the test usually learns something 
about the case but not necessarily anything that can be stated sta¬ 
tistically. Ill many cases it would he grossly misleading to assign 
a mental age, 

IL mi-IERENT WEAKNESS OF THE STANFORD 
REVISION, FOR CLINICAL USE. 

No single sysLom of tests is equally well adapted to all classes 
of subjects, The Binct scale is especially adapted to children of 
normal mcutality, and in this field I can agree with Tcvman that 
“Ill the large majority of ca.ses persistent silence deserves to be 
scored failure." School children arc in general the most responsive 
subjects I have ever had occasion to test, not excepting psycholog¬ 
ically trained university students, and the mutter of obtaining their 
co-operation is not a serious problejn. 

But this does not hold for clinical subjects, even when they are 
tested in schooU The mental measurement ol defectives requires 
n much fiiior technique than is necessary for bhe classification of 
normal children,, and at best there is serious danger of rating a 
child too low. The younger children who are brought to the school 
clinic are apt to be timid in the presence of n stranger, and the 
older ones are usually suspicious and sensiLivo, Defective speech 
is very common, frequently serious enough to make the child shy 
and self-conscious, ant] sometimes so marked that his answers are 
nnintelligible. Deficient children are very susceptible to fatigue, 
and the examination is usually too long, except for a child rating 
very low, to be made properly at one sitting. 

When the external conditions are favorable and when there is 
no lack of time, I find the lower end of the Standfovd scale fairly 
satisfactory for testing English-speaking children who are free 
from speech defect. If a child is too young to realixc that he is 
being tested for mental deficiency, it is merely a question of time 
to overcome his diffidence aud to gain his confidence. He regards 
the test as a school exercise, and responds to the examiner as well 
as to a new teacher. 

Many of the difficulties encountered in the clinical use of the 
sca>e are clearly recog nisied by Term an and cited as exceptional 
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situations which should be met by some special mode of procedm-e.^ 
But in the.clinic these difTiculb situations are the rule rather than 
the exception, aiul the means suggested for overcomiiog thorn are 
usually impracticable, Under ordinary clinical conditions, as when 
the children arc brought from a distance or when they are exam¬ 
ined in school by a visiting psychologist, it may he hnpossiblci to 
take the child out for a walk in order to establish a friendly fecL 
ing, to allow two sittings for an examination, or to resort to any 
of the measures prompted by common sense. A full "Out-Patient 
Day” i.s nob conducive Lo accurate work. The examination is us¬ 
ually too hurried to be satisfactory, and after four or five equally 
unsatisfactory tests performed in quick succession the examiner 
may he too tired to take proper interest in subsequent tests, 

My principal objection to the lower half of the scale when used 
for juvenile subjects is that it requires conditions more perfect than 
usually obtain in the clinic—^more perfect than I have ever seen 
in any clinic. But for any subject able to go above the eight-year 
level and for «an adult subject of any grade of nienlality, the de¬ 
fects of the scale are more serious and more fundamental. 

Perhaps the most delicate situation whicli we meet in the psy¬ 
chological clinic is that pi'esentod by the examination of a self- 
supporting young man or woman of border-zone intelligence, who 
requires supervisory care bee an sc of some problem relating to con¬ 
duct. The subject may be painfully aware of his intellectual short¬ 
comings, and the humiliation of being tested for mental deficiency 
is almost more than he can bear. If the test ia to be valid, we should x 
be able to offer something sufficiently interesting to draw his atten¬ 
tion away from himself as a subjecL-who-is-suspected-of-being- 
feebloininded. But the tasks of the Stanford scale arc strongly 
conducive Lo self-consciousness, especially the questions relating lo 
school life. It is little less than inhuman to require a serious 
answer to the question ”What should you do if in danger of being 
late to school?” 

The vocabulary test furnishes a good ill u strati on of a tost that 
is well adapted to school children but very poorly adapted to the 
clinic, A bright boy may regard it as a joke when his limit is 
reached, and I have never seen a normal child manifest serious 
annoyance over the series of failures with which the test is invari¬ 
ably brought to a close. But those failures are disheartening to 
the sensitive clinical subject, and the situation becomes more tense 
with each succeeding question. The test is, therefore, unduly 
fatiguing botli to subject and examiner. 


'-TUt\ Mona u re 111 out of Intelligence, pages 12*1 to 130. 
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It ia not nocessai'y to consider each question individually.* The 
fundamental wcriciicss of the systenn is that too little account is 
taken of the affective reaction of the subject, Termaii nasumesj as 
(lid Biuet, that the questionci can be presented in such n way as to 
arouse the interest of the subject. But even if so, it is a serious 
defect of the system, for clinical purposes, thnt so much depends 
upon the presentation. As moat of the subject matter ia of no 
intrinsic interest to sub norm nl adults and adolescents, the resources 
of the examiner are severely taxed in the effort to make the test 
attractive cnon&h to hold their attention. And the rules for the 
administration of the tost, when they are followed literally, make 
the examination unduly lengthy and tire so me, The examiner is 
expected to cover one year wholly within the range of the subject’s 
ability and one year wholly beyond bis range, thus including at 
least twelve questions that are frankly nondiscriminative for him, 
besides many more that are probably so. It is these nondiscrimi- 
native questions that are most disturbing to the subject’s emotional 
equilibrium, I-Ie is annoyed and discouraged by those that he can¬ 
not answer and frequently feels insulted by those which are so 
easy as to require no thought. 

It is of no small importance, in the interests of accuracy, that 
a clinical test should be easily and comfortably administered. 'At 
best a day's work in the clinic is usually too exhausting to be 
done as it ought to be done. One who is engaged in collecting 
material for n new test of liis own devising may well tliink noth¬ 
ing of working eight or even ten hours at high tension, because 
all thought of fatigue is overshadowed by the exhileration of 
watching the returns come in. But it is very different to spend 
n whole day making routine use of that same test after it has 
been published, and still more different to spend a day making 
routine application of a test for which one. has no personal af¬ 
fection. Much of the routine testing in clinics is done by persons 
of comparatively little training, who have no vital interest in the 
results and who are not qualified to make constructive use of 
their observations. And if their work is made unreasonably dif¬ 
ficult, it is conceivable that some of them will lighten the burden 
by taking unwarrantable liberties with the technique. 

III. SUGGESTED CRITEEIA FOR CLINICAL TESTS. 

It is much easier to point out defects in the tests we are using 
than to devise methods for correcting them. Most of my recom¬ 
mendations are negative, but it can do no harm to call attention to 
the particular needs of the clinic. 

1. The task or problem should possess sufficieTit intrinsic in- 

^Thc inapliroi)rlrtteiii*.HH of I lit* Stnnford Ucvlnlon HiibJoeL mntLor, as iippllotl 
to jhIuU Bubjoclu, lina boon OIbcukngO by WgIIu and Kelly, IntelUfjencG aitO 
Psyche ft is, Am or leu 11 .lournnl of In.snnlly, .Tilly, 
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terest so that the subject will usually regard successful perform¬ 
ance as an end in itself. Spontaneous co-operation on the part 
of the majority of subjects should be considered essential. It ia 
not to be expected that any test will meet with universal approval 
among clinical subjects, but there should be no tasks which are 
commonly performed only in response to urging. 

2. Any test used for examination of adult subjects of what¬ 
ever grade of mentaliLy should possess sufTicient dignity so that 
it can be offered to a mature, self-respecting man without insult¬ 
ing him. Questions should relate to politics, travel, the industrial 
world and other subjects of universal interest rather than to school 
life. All material that ia essentially puerile should be rigidly ex¬ 
cluded. 

3. The requirements for each task should be simple and easily 
understood so that it may not be necessary to tax the attention 
of the subject by n long and involved explanation. Repetition 
should not be necessary and the time required for presentation 
should be negligible. 

4. Questions which call for oral response, if used at all, should 
be satisfied by very simple answers, 

6. The administration of the test should not be so exhausting 
as to inalcG it impossible for an examinar in ordinary health to 
put in a full day's work of evenly good quality. Progressive de¬ 
terioration in the quality of presentation should be avoided by 
the use of tests that be presented with the minimal amount of 
actual labor. There should be very few tests, if any, which re¬ 
quire the reading aloud of long paragraphs, and very few, per¬ 
formance tests which call for close observation of the subject's 
movements. No tests should require hair-splitting distinctions as 
to what constitutes an erroneous movement. 

6. Time limits are necessary in order to prevent an examination 
from being too long and tedious. But the time allowance in most 
tests should be liberal enough so that the subject will not be con¬ 
scious of working under a time limit. Many normal persons are 
unable to do themselves full justice when working under high 
pressure, and it is unfair to class a person as deficient primarily 
on the ground that he becomes disconcerted when hurried. 

7. Tests which call for reading knowledge on the part of the 
subject have a relatively small place in the clinic, Adult subjects 
who can read a little are usually very sensitive about their in¬ 
ability to read fluently, and the exposure of the deficiency jn read¬ 
ing knowledge may be so disturbing emotionally as to invalidate 
the rest of the examination. Also, there are many clinical sub¬ 
jects who cannot read at all. 

8- Testa which elicit obvious failures should be avoided' as far 
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as possible. .Such errors as are necessary to make a test dia- 
criminative should be interspersed among sLiccesafiil porformaiiccs, 
so that the subject will not be discouraged by the sense of failure. 
Tests in which the subject will be wholly unaware of his errors 
are especially valuable. (Healy Pictorial Completion 11 furnishes 
proof that this is not impossible. A subject may ?nnke ten er¬ 
roneous placings which not a minus score, iiiul yot be perfectly 
satisfied with the result). 

9. A scale of tests intended for cHnicnl use should he of rather 
loose construction, so that thoroughness of the examination may 
not be dependent upon any particular test or group of tests. The 
system of scoring should permit giving the subject n rating on 
tests that are well suited to his command of language and his 
ability in general. It should not be necessary to give him ei test 
that is hopelessly beyond him merely to prove that he cannot pass; 
nor, on the other hand, to give a lest that he will take as an insult 
to his intelligence merely to prove that he can pass. The gGnornl 
plan of standardization for performance tests in which success or 
failure is obvious to the subject should be such that the examiner 
may permit or assist a subject to finish a task after the time limit 
is passed, so that the subject need not know of his failure to pass 
the test. And the rules for administration should be liberal enough 
to permit the examiner to select tests in accordance with the in- 
lorcsts and ability of the subject. 

Other criteria, of course, arc essential, But it is not necessary 
to enumerate here the various standards to which oducatio-nal as 
well ns clinical tests are expected to conform. 

The development of n scale which shall satisfy these require¬ 
ments is a problem for collective rather than individual effort. 
However, individual contributions are not wholly at a discount, 
and at worst the problem is diihcult enough to be intensely inter¬ 
esting. 

IV. A TENTATIVE COMBINATION SCALE 

This is offered somewhat prematurely, as a preliminary study, in 
the hope that it will encourage the splitting of composite educa¬ 
tional tests into their component parts and the publication of inde¬ 
pendent norms for the separate units. 

This plan for using n iniscellaneoua group of tests as a sub¬ 
stitute for a standard scale is essentially the method suggested 
by Pintner and Paterson* for deriving a mental rating from a 
group of testa that w&ve standardized more or less independently. 

It seems to me that we can make a closer approach to the true 
mental age—^if there be any such thing—by basing the estimate 
upon the median of a number of independent mental ratings? than 

VI fictile of rcrfornutucu Tcstitj oluipLur VI. 
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by accepting as Xinal the rating derived from any singlG system 
of tests. I believe fiirtlier that it is an advantage, other things 
being equal, to use testa drawn from different sources, developed 
by different authors, and standardized by results obtained from 
different sets of children. In this way the total number of normal 
subjects contributing to the norma is greatly increased, and certain 
constant errors, such ns the per son nl bias of the experimenter, 
tend to be counteracted. 

It is only as a tentative measure that I am willing to accept the 
term ^hnental age'^ as the end result of the scries of tests, I con¬ 
sider the term absurd as applied to adults, and believe it to be 
frequently misleading as applied to children. It is far too readily 
understood, and is therefoi^c used loosely by persons without psy¬ 
chological training. Worst of all there is a strong tendency to 
pass it around carelessly among workers in the clinic, sometimes 
within the hearing of a subject who is capable of comprehending 
its meaning. But although I strongly disapprove the use of this 
term and greatly prefer the percentile method, I find it necessary 
to express results of different tests in a term that will serve as a 
common dc no min a‘■or, and ^hnental age'' is unfortunately tho most 
convenient term for this purpose. My present aim, therefore, is to 
collect a large number of short-time tests which yield independent 
mental age ratings. 

An abbreviated form of the Stanford scale—usually two or oc¬ 
casionally three items for each year—furnishes one unit of the 
series, Ilealy Pictorial Completion II is an exceptionally valuable 
test for English-speaking subjects of high grade. Of the fifteen 
tests of the Pintner-Paterson performance scale, I find the fol¬ 
lowing especially useful: Mare and Foal Picture Board, Seguin 
Form Board, Five Figure Board, Two Figure Board, Casuist Form 
Board, Triangle Tost, Diagonal Test, Ship Test and Substitution 
Test. Other tests which I am using already or expect soon to add 
to my collection are as follows: Kohs Block Design Test, Holley 
Vocabulary Test, Ferguson Form Boards, Cube ConstriicLion Test, 
Dearborn Form Board, Pressey Primary, Pressey Intermediate, 
Otis Intermediate, and selected tests from the Herring Revision of 
the Biiiet-Siinon Scale.“ 

The essential feature of the programme is that each task pre¬ 
sented to a subject can be selected with special reference to the 
interests and ability of this particular subject. Any lest which 
does not elicit good co-operation is to bo dropped, and the record, 
even if complete, is not to be counted in the series. 

*^1 wish (o oxpri'HH my KniLlLudo lo Dr. .T. P. Herrini?. 'who Iihb Nuppllcd 
mo with i-nroi-clH from whlrli 1 umi compute Hgc norniH ]uv iiiiy Ivata ^vhlcli 
1 wiHh Lo use. 
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The tests used in niiy ej^umination should be as varied ns the 
■subject's ability and interests permit, and it is important to have 
a larger collection from which to draw, especially af verbal tests, 
If it were necessary to choose between languagfe tests and i)erform- 
ance tests I should give the preference to performance tests, be¬ 
cause nearly all clinical subjects co-operate more readily in these 
testa than in tests requiring an oral response, and because there 
are many subjects who cannot be reached at all by language tests. 
But performance tests are limited in their scope, and many of them 
are highly susceptible to the influence of chance. Tliey do not take 
the place of language tests, for subjects who have fair command 
of the language and the frame-work of the method will not be 
complete until verbal tests nre available in much greater variety. 
The verbal-performance tests which are now being used extensively 
in schools offer a wealth of material lor this purpose. The Ter¬ 
ra an Group Teat, for example, contains several units which would 
be exceedingly useful in the clinic, given as individual tests. It 
will be necessary, of course, to compute norms for the separate 
units before they can be used in this sclieme.*^ 

It is my plan to use in approximately equal proportions tests 
which depend upon accuracy and tests which are scored by speed. 
While it is of course impossible to disLiiiguish between those two 
variables in a strict sense, I think we are justified in disregarding 
one or the other in practice. In those pei'formance teats in which 
the performance leaves no record of the errors, the difficulty of 
counting the subject's moves introduces a source of inaccuracy 
which it is particularly desirable to eliminate, since thci'C is no 
way of checking up the examiner's count, In the Pintner-Paierson 
tests which I am using most freely, the error curve runs almost 
parallel to the time euwe. It is true that the time record does not 
tell the whole story, but I cannot see tliat the count of moves or 
errors adds anything to it, and I think the examiner's time can 
be spent more profitably taking notes lor qualitative study of the 
subject's mode of procedure. In giving the Koha test recently to 
adult subjects of very superior ability, I observed that some toyed 
aimlessly with the blocks, thus making many useless moves; some 
worked by trial and error, moving so rapidly that I was unable 
fcg coupt the moves with even an approach to accuracy; and some 
worked very deliberately, with almost no false movements. All 
gave high scores, and the number of moves depended, apparently, 
more upon temperament than upon the ability measured by the 
test. 

“I iitii ]]uk'l)U‘(l Lo Dr. Duollii Pri'Hsc-v for provkLlui^ m<‘ wUh 

iiorinn fi)i‘ du' four purLs Hip L'rcHsry Prlmiiiry li‘sH Tills rni'iil,slii‘s Puir 
(‘xci'Uoiil vorl)iil-p<'rftjnnaiifn losls for HuhJoels who iiiuh-rsliuul DnglJsJi 
Uni ^YU^) CAiniut 
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The mentfll cLtained from a given subject by different 

tests usually vary quite widely, sometimes ranging from sixteen 
yenrs Lo zero. This may be due in part to the influence of chance 
upon some of the mechanical performance testa. But ns the rat¬ 
ings which are a (Tec ted by chance tend naturally to approach the 
extremes of the series, they do not invalidate the final result. In a 
series of fifteen tests it is not uncommon to find the middle four 
or five figures almost identical. If the ratings are fairly uniform 
I consider n series of ten tests aufficient, and I have occasionally 
assigned ix mental age on the basis of nine tests. Ordinarily I 
prefer to make at least twelve tests. 

The mental age as finally recorded is the median mental rating 
of all the tests—never less than nine—which are clearly discrimi¬ 
native for the subject; exclusive of any tests in which he does not 
give good co-operation and any tests which are too easy or too 
difficult to measure lii.s ability. In the Manikin tost, for instance, 
the highest possible score has a mental age value of eight years. 
If this record were counted in the series of a subject rating over 
eight years, the median would be lowered one point, and it would 
bo absurd thus to penalize a perfect record. A test so difficult as 
to yield a zero score would have exactly the same effect upon the 
median, and it would be possible in testing a subject of low grade 
montality, to give enough too-diflieult tests to bring the median 
down to zero, A zero score docs not necessarily prove the test to 
be non-discriminqtive, bull count the te.st too difficult to be discrim¬ 
inative when the subject works persistently up to the time limit 
without making any appreciable progress toward success. The 
examiner’.s errors in selecting the' tests ought not to be counted 
against the subject's mentality, and it is clearly unfair to include 
these records. 

By beginning with a test having a wide range of discriminative 
capacity and gauging the subject's ability by the 'results of tlie 
first test, it is usually possible to avoid giving non-discrimina- 
tivo tests. For a subject of low grade mentality I u.sually 
begin with the Segiiin form boax*d or the Mare and Foal picture 
board. For a subject of high grade the ICohs Block Design test 
is very satisfactory for the first presentation, because of its \vide 
range of applicability and especially because of its unusual attrac¬ 
tiveness as a toy. 

SUMMARY 

An indefinite series of short-time mental tests, verbal and per¬ 
formance, is recommended for use in the clinic as a substitute for 
a fixed .scale of tests. Any short test for which an independent 
age norm is available may be used in the series, and the mental 
age is derived by taking the median rating of ten to fifteen tests 
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which are cloni'ly discrimiiiative for the ability of the subject, 

Many composiLe educntionnl tests which are not siiitfiblc for 
clinical use in theiv entirety contain parts that would be highly 
valuable as single units of a series. The publication of norms for 
sinall homogeiiGous units, in addition to the norms regularly pub¬ 
lished, would be conducive to the wider iiacfulno.ss of tests intended 
for educntionnl surveys. 

The following advantagos of this method over the Stanford Re¬ 
vision liave been observed: 

1, The method is move elastic than a fixed scale, move adapt¬ 
able to the interests of the subject. By selecting tests that tire in 
line with his interests, it is possible to obtain better co-operation. 

2, The method is adaptable also to the special qualifications of 
the examiner for administering tests, and the routine work of 
testing is thus made more attractive and loss fatiguing. 

3, The method is less mechanical. By allowing more room for 
common sense in dealing with a .subject, it is conducive to more 
careful observation of the patient ns an individual. 

4, By placing less respon-sihility upon the examiner for the ob¬ 
servance of petty rules, it reduces the chances that undue liber¬ 
ties will be taken with the technique of examination, 

5, If the tests are well selected, it allows less play of personal 
equation in the .scoring of results. 

6, It is more economical of time. The period is spent upon 
tests that really test the ability of the subject in a given direction, 
and no considerable amount of time is wasted upon tests that arc 
either too easy or too difficult to show definite findings. There is 
also an absolute saving in tlic time required for testing a subject 
of high grade mentality. 

7, The validity of the results is not dependent upon the sub¬ 
ject’s co-operation in every test presented or in any particular test. 
If he can be induced to co-oporale in any ten tests, it does not 
matter, for the validity of the test, how many questions he I'efuscs 
to answer, 



FRESHMAN TESTS IN THE SMALL COLLEGE^ 


By Elsie Murray, 
Wells CollegG 


III this era of rapidly expanding college populations and chang¬ 
ing Btandnrds in entrance requirements and curricula, the uses of 
a freshman intGlIigence test are manifold. In the smaller college 
admitting by ccrtilicaLe only, one may desire a criterion by which 
to gauge the quality of successive entering classes of entrants 
with nnd without Latin; or of students in the college in point with 
those in other institutions. The test findings are also ut»livable in 
connection with student guidance, to detect special abilities or dis¬ 
abilities, and to throw light upon cases of academic failure. There 
is, besides, the possibility of discovering a teat combination which 
may later prove of value in the selection of deair able (or the elim¬ 
ination of undesirable) candidates for admission. 

With all of those objectives move or less in view, a freshman 
group intelligence test was given nt Sweet Briar College, in the 
fall of three successive years: November 20, 1919, to 119 fresh¬ 
men (class of 1923); October'26, 1920, to 116 frcshm'^n ^1024); 
and 29 sen/ors (1921); October 19, 1921, to IIG freshmen ^1^25) 
and 32 seniors (1922), The blank used was the Thurstone Psy¬ 
chological Examination for College Freshmen, in its 1919 form 
in 1919, and in the 1920 form in 1920. This test, which is ar¬ 
ranged in *cydc-omnibus' form, with a single time limit, requires 
only 30 minutes, and calls for no formal oral instructions. It was 
administered simultaneously to groups of about 40 each, by in 
structors coached by the writer. 

0x11 of the various possibilities available in 1919, this particu¬ 
lar blank was selected for trial, in part because of ease of admin¬ 
istration, and economy of time and expense; largely, however, be¬ 
cause the types of problem represented (andlogies, informaiiont 
in(ttchin[j of abstract statements, judgment on the truth or falsity 
of arguments, sentence completion, completion of number series, 
in the IfllO edition, the same with the substitution of an extra ^oord 
test, and arithmetical problems for the two lash mentioned, in the 
1920 edition), had previously proved highly reliable in the writer's 
testing of college women (juniors and seniors).'^ Aa compared with 
Army Alpha, the Thurstone combination seemed better adopted to 
call out genuine and sustained thinking ability on the part of the 

Ilia nii<I GO-op<?rrtMOfi in tlie ffndjering of rtnin for tJals p/ii)er flJnnfjfl 
firo (Ii»' lo JSjnlJio iMcVon, and Dr. jMjiry iJnrlcy, of 

Hwocl Th'iiir College. 

“I’l. Murniy: PbyvhoUtoicaJ Teata ns Diagiioaiio of Vocational Apiiluiles 
in CoJlcgv Women. Joiu’njil of Applied Tsycliology, March, 1020, pp. 
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student tested. In the long- run, we must adinil, the Hent-jiwii com¬ 
pletion test in the 19U) edition, and tlie aritlimciical problems of 
the 1920, were found to constitute a serious obstacle to our use of 
this test. Not only does the substitution of the latter problems for 
the former invalidate the coniparnlive value of test scores in suc¬ 
cessive years, but the wide variations in the possible solution.^ of the 
former (of quite (liA'ercnL qualitative vnluo), prevent any con¬ 
stancy in scoring from year to year. As rcKurds the aritlnnctical 
problems, many stvuicnts fiiitUng them to consume ft dispropor¬ 
tionate amount of time, simply omiltcd them entirely, thus running 
up relatively high score.s for speed (problems correct) ns com¬ 
pared with those of more conscientious individuals. 

UAW UKSUl/l’K. TUIUTMKNT (IF SC'OUMS. DlSTUlUrTLflN. 

Of the 443 students tested, only three covered the blank (1C8 
problems in the 191D edition, 182 in the 1920) within the time 
limit set. Among the seniors, no one scored higher than 152 cor¬ 
rect out of 168, or 144 out of 182 among the fre.slimen. The tost is 
therefore approximatoly long and hard enough for the group Con¬ 
cerned, in the time allotted. 

The pedagogical diiliculty of handling students of widely vary¬ 
ing mental calibre in a single section is a commonplace in educa¬ 
tion. In view of thi.s, the range of scores within each freshman 
group is worth remark, The speed and alertness iiuUcaicd by the 
upper scores (tu problems correct a net profile ms covered) is two to 
throe times that represented by the lowest scores (see Table I). 
The range in proportion of errors and omissions to problem.^ cor¬ 
rect, as measured by percentage accuracy^ is also striking, though 
less extended (56 to 9C% for 1023). 

The importance of calculating the percentage accuracy as well as 
the number of problems correct was first suggested by the fact 
that certain of the problems are couched in such a form tliat mere 
guesswork may yield a considerable number of successes; secondly, 
by scrutiny of the academic recovtla of individuals in whom n 
relatively good .score in speed or prohlcins correct was observed to 
be accompanied by n relatively high proportion of errors. In 
many such cases, academic success or failure was foiiiul to bear 
a closer relation to tbe score in accuracy (number correct divided 
by number covei-ed) than to the score in problems correct, IC. g., 
in 192B, in more than half of the cases ol striking dislocation be- 
Lw(;en decile rank in grades and in tests, the discrepancy is con¬ 
siderably reduced by substituting rank in accuracy for rank in 
jn'oblcms correct (see Table VIII), It seems not unlikely that 
while the latter may constitute the better measure of mental alert¬ 
ness and agility, in certain fields, the former (percentage accuracy) 
is n truer gauge of aU-roiind ability, or at least of certain character 
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traits-stability, perseverance, effort, ambition, and the related 
qualities, vrhich enter so Jnrg’eJy into the determination of academic 
success. 

According-ly, nfter considerable experimentation with scores and 
corroUitioii coofricicntg, the method was adopted of computing an 
'adjusted score/ by subtractinff the sum of the errors and omic- 
siona from the mimbcr of successes. The coefficient for these 
'adjusted scores’ and freshman grades ranges from +.42 to +.44 
for the differcnL classes, and is always higher than that for the 
speed scores (e.g,, for 1224, the correlation for academic grades 
and number of problems correct is only .375; for grades and ad¬ 
justed scores, .42), Each class was then splU into ton equal sec¬ 
tions or deciles, on the basis of this score, those in the highest 
decile given a rank of 10, those in the lowest of 1, etc. Decile 
ranks were similarly determined for each student both in problems 
cavrecty and in accuvacf/ (Inter, in facuUif estimates and in [/rades) 
and a copy of the whole placed on file in the I'egistrar^s office fov 
consultation by instructors and faculty advisers who desired 
further light on backward or promising students. 

This adjusted score, it is obvious, raises somewhat the standing 
of the 'slow but .sure' individual, (over the fairness of whose 
rating in a speeded teat those iinfaniiliar with mental measure¬ 
ments feel such concern), ay it also lowers somewhat the rank of 
the slap-flash, swift IniL careless; and there becomes thus available 
a set of three score rankings, which furniah jointly a more satis¬ 
factory mental picture of the individual than any one taken singly, 
Tho usual combinations of swift and inaccurate, slow and accurate, 
swift and acciiralG, and slow and inaccurate, obtain. While decile 
combinations of 6-1-3, 1-9-4, etc., for speed^ accuracy and adjusted 
score, arc not uncommoHj and the correlation coefficient for speed 
and accuracy in 1923 was only .37^/4, there are also noteworthy 
cases of 10-10-10 and 1-1-1 (see Table II). 

COMPARISON WITH FIIESHMEN SCORES IN OTHEU COLLEGES 

The average score in problems correct for 1923 is 85,4. This 
falls a trifle below the corresponding averages quoted by Thurs- 
fcone^ for Liberal Arts anti Engineering freshmen—86.6 and 88.8, 
respectively. The average for 1925, using the same teat form, 

^L. L. TliiirHloiu’; A OyeJe-ihifnihufi /nfWIh/ciKc Tcvls, Jiuii-iuil of Ediicft- 
lloniil llPHoaroh, Kov. p. SliH. Tlu* niiuro ol: nvonigos riuulod for ‘M 

Llljornl AutN ooilrifos nrii« Trum IU.« to 1«7; Uir 43 JiiiffhiccWiijf fidiogJfl 
fi'oin 70 to 
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TARLIS I 

DISTWBUTION OF SCORES IN FRUSHMAN TCSlvS, 443 SIIIIJECTS 
Fl'C>sl(mieii Seniors 


Class 

1923 

1924 

1925 

1921 

1922 


No, Students 

149 

116 

ILG 

29 

32 


No, Problems 

108+ 

182*+ 

168+ 

182** 

168* 


Highest Score 

108 

169 

158 

182 

108 

No. Problems 

76 Percentile 

119 

122 

126.6 



dovored 

Median 

lOB 

107 

113,5 

119 

13B 


26 Percenlilo 

94 

93 

98.5 




Lowest Score 

03 

00 

62 

83 

105 


H 

1G8 

109 

166 

176 

167 

Attempted 

Median 

102 

104 

111 

115 

136 


L 

58 

61 

61 

83 

97 


H 

143 

144 

132 

140 

152 

CoiTOct; 

75 

QG 

91,.5 

102 

12fi 

122 


M 

83 

80 

90 

98 

108 


25 

71.5 

09.,') 

77 

87 

99 


L 

49 

42 

53 

53 

84 


H 

9G 

92 

95 

96.5 

94,3 

Pevccntng’c 

7B 

84 

84 

87 

88 

SB 

Accuracy 

M 

80 

76.6 

81 

82 

84.8 


25 

73 

71 

7G 

76 

80 


L 

56 

43 

60 

55 

62.5 


H 

118 

122 

124 

131 

130 

Adjusted Score 

75 

78 

08 

82,5 

99 

103,5 


M 

GO 

56 

07 

73 

8j,5 


2i 

45 

42 

55 

r,9 

'’6 


h 

12 

—23 

30 

10 

42 



* 1919 edition of test, 
** 1920 edition of test. 
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rigea to 90, a figiu’Q sliKhtly liigher than cither of ThursLone's 
averages- There ia, however, a weak spot in these comparisons,— 
the Sentence Completion test, which occurs in the 1919 edition, and 
the §caring' of which it has proved impossible to atandardize fairly. 
measurement op improvement JN successive ENTEIimo CLASSES 
In the use of the tests to men sure the mcnlcil calibre of succes¬ 
sive freslimati cIussch, tlio scoring difTiculty above mentioned again 
'arises, riowover, the scoring standard for sentence completion in 
1921 was apparently more ^ovcj^c, operating if at all to lower the 
score for Lhc dnss of 192i>i fliiice the median number of correct 
answers for this type of problem remains fitatioimry for this 
class, while the medians for all other problems rise a point or two* 

TABLE II 


WEST RECORDS WORST RECORDS 

No, Adjusted No. Adjusted 

Correct Accuracy Score Correct Accuracy Score 


1923 Score 

120 

96% 

115 

62 

56*6% 

12 

Decile Itk, 

10 

10 

10 

1 

1 

1 

192.1 

135 

91 

122 

56 

46 

-10 


10 

10 

10 

1 

1 

1 

1921 (Senior) 

130 

96.5 

131 

63 

55 

10 


10 

10 

10 

1 

1 

1 

1925 

131 

95 

124 

62 

67 

30 


10 

10 

10 

1 

1 

1 

1922 (Senior) 

152 

90.6 

136 

106 

62 

46 


A second hitch arose from the altered form of the test offered in 
1929, the arithmetical problems of which proved a stumbling block 
to our students, many of whom possess a veritable 'number 
phobia.' The median score for this year drops in consequence 3 
points instead of rising, although the general academic record of 
this clfusa is above that of 1923, A certain degree of improvement 
in 1925 as compared with 1923 is, however, clearly discernible 
(see Table I and IV); median and lower limits are both higher, 
though no individual in 1926 attains as high a score as th-e best in 
1923. 

In Tables HI and IV, the relation of senior and freshman 
groups is presented. Since the best senior scores barely exceed 
the heat freshman, the claim of the intelligence test to measure 
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native endowment rather than acquired ability or knowledge would 
seem to be substantiated.' Only ’informaLicn and analogy 
scores of the seniors ascend disproportionately; the latter perhaps 
because of familiarity with similar tests gained in Psychology I. 
The bulk of each senior class ranks in the highest quartile of the 
freshman class subjected to the same edition of the test. This ia, 
of course, as it should he, through the nsilural process of selection 
and elimination of the weaker operating over three college years. 
There remain, to be sure, in the senior classes n number of strag¬ 
glers in the lower quartiles whose academic status is for the moat 
part as unsatisfactory as their intelligence rating. 

In order to chock the operation of selection versus training more 
exactly, in January, 1923, when the freshmen tested in 1919 were 
seniors* the number of survivors in each of the original qnnrtiles 
was tabulated (see Table III). The percentage of the survivors 
ranking above the median was found to bo only 61 per cent, a 
figure somewhat below that for senior-froshman comparisons when 
two classes are tested simultaneously, the former in their senior 
year (84%). The 25, 60, 76, 100 percentiles for 1923 seniors were 
also found to average only about G points higher than those for 
the same group as freshmen, although the discrepancy between 
senior and freshman medians for 1922 and 192B (tested simul¬ 
taneously) was 18 points. Granted that the quality of entrants 
has not deteriorated from 1917-1921, individual improvement would 
seem to play a more important vole than selection in raising senior 
scores.® Even so, the rise to be credited to aenior superiority in 
training—in knowledge, aplomb, concentration, grasp, or what not 
—say 10 or 12 points on the average, forms only a fraction of the 
total range of difference in abilities in the original group (90 to 
100 points). In other words, three years' college training would 
avail, presumably, to shift the rank of a given individual hardly 
a couple of deciles—a conclusion borne out by the records of re¬ 
testing in the sophomore year, where the average gain approxi¬ 
mates a decile, 

^Tlio fiict tlint scores vary on tlio nvcnieo limrsely with Llie nge of the 
subject, from 10 to 21, inlgfht nlso be eltcd na evidence that the Lest ihooh- 
not ftmownt of Lmlnliig, but native Ability. 

"Al:l:hoii|?h, before proceeding to niiy auc/i conclusion, IJie umiBiinl losscfl In 
tlie upper teat nnd gnnle decilca of 1023—largely throutfh transfer to other 
instUutloriH—should be drmvn Into the cnlculntlon. 
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TABLE III 

HATING OF SENIORS WITHIN THE FRESHMAN QUA:IT:L“S. DISTRIBUTION 
1921 1922 1921 1922 1923 

Fcr Problems Gcrrcct Per Adjusted Sc:r3 Cjrrect. Adj. Score 
Quartile* Frequency 

IV 17 21 18 20 13 11 

III 7 9 7 7 10 10 

II 2 2 1 4 8 9 

I 3 .... 3 13 4 

Total 29 32 29 32 34 

Above median, 24 30 or 26 or 27 or 23 or 21 or 

or 83 pr ct. 93 pr ct. 86 pr ct. 84 pr ct. 66 pr ct. 61 pr ct. 
“^Quartile rank in terms of 1924 freshman records for 1921, seniors 
in terms of 1925 freshman records for 1922, seniors 
in terms of 1923 freshman records for 1923, seniors 
LATIN ENTUANCE CREDITS AND INTELLlOilNCR RATING. 

In order to estimate the possible detriment to the student body 
of altering the conventional Latin entrance requirement of the 
eastern colleges, both intelligence rating and academic standing 
for the freshman and sophomore years of students whose entrance 
certiheates showed respectively 4, 3, 2, 1, or 0 Latin credits were 
tabulated. As shown in Table V, the median intelligence rating 
of those offering the standard number of units (4) is only slightly 
above the rating for those offering fewer. Furbhei*, the individuals 
of the two groups are similarly diatribuled over the ten test 
deciles, and the ratio of students above and below the median is 
practically the same (1 to 1) in each division. Adhering to the 
old 4-point Latin requirement would have cost the college 6 out 
of 15 of the most promising members of 1923; 4 out of 11 of 1924; 
and 2 out of 12 from 1925. If the intelligence test is a reliable 
indicator, the 4 unit Latin requirement is no longer the sieve for 
eliminating the weaker students which it seemed to be ten or 
fifteen years ago, when the brighter minds in the secondary schools 
were urged to complete the four years of Latin in the classical 
course, and failure to do so was a fair indication of either sloth 
or stupidity. This requirement now cuts out the sheep along with 
the goats. 

From the point of view of academic success, at least in the 
sophomore and freshman years, the comparison of the reduced 
credit with the standard group is less favorable. The median 
grade for the former is somewhat lower, the number of students 
above the class average proportionately smaller. At the same 
time, the students of this group range through all the deciles of 
grade rank, and their elimination through a 4-point entrance re- 
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quircmenl would have cofib the class of 1D23 5 out of its'best 13 
students; 1924, 1 out of 13; 1925, 3 out of 11. 

Assiffiimenl of the reasons for the _sliKlitly lower academic 
achievement of the Sweet Briar student with reduced Latin en¬ 
trance would he impossible without a fuller analysis of the con¬ 
ditions govern in admission than is here ])rac tic able. There is, 
liowcver, no real evidence Lhiil it indicates that the lack of Latin 
handicaps tlic sludeiit in either linguistic or scientific studies,® It 
may indeed signify that the steadfast pursuit of Latin studies is 
still in £i degree a measure of the scholastic ambition and energy 
of the special group of students who apply to Sweet Briar for 
admission. This latter view would, in fact, seem to be supported 
by the falling away of 3-0 point Latin entraiiLs in tlm sophomore 
year, as compared with 4 point—ace Table V, in which the ratio 
of the former to the latter drops from roughly 1-1 to 1-2 for 1023, 
from 3-5 to 1-2 for 1924, in the sophomore years as compared with 
the freshman. This falling olf is not, however, to be ascribed 
entirely to lack of scholarly ambition. The inability to obtain an 
A.B- degree on less than the full Latin entrance requirement 
oiicrntes cither to discourage students from continuing in college, 
or to eiicourage their transfer to other in.stitutions, e.g., state 
universities, where the lack of Latin is not a himdicap. The effort 

TABLE V 

LATIN ENTUANCE CREDITS AND INTELLIGENCE RATING 



FREQUENCY OP 

CREDIT 

GROUPS 


Class 

No. 4 3 

2 

1 

0 

Tot, 0-3 Credits Year 


Fresh.ia23 149 

79 

18 

32 

6 16 

70 


man 1924 116 

71 

14 

24 

7 

45 

1925 

IIG 73 17 

22 


4 

43 


1923 

4G 




27- 

Sopho- 

1924 

44 




20 

more 

1925 

50 




32 



CREDIT UNITS 

AND INTELLIGENCE 

RATING 



Median Test Deciles 





1923 

6 5 

G 

4 

(> 

5 


1924 

6 5.5 

4 


6 

5 


1926 

6 5 

G 


4.5 

G 



academic rank 




Median Grade Deciles 





1923 

6 3 

4 

4 

G 

4 


1924 

6 3 

5 


4 

4 


1926 

7 4 

5 


3 

4 



'‘TliP lOii-Ush tM-iUlcs fnr Mio 1 iinii LiHlii millrU'iiliilt's ol' rJ'Jn lu-luiilly 
nvi'i'iiir*' luwci- Ihfiii (liosu for tlip uiiiL groiui. 
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to inalcc up the missinff Uatin credits in co11ck« in order to enter 
iav the A.B. degroe while cunyijiR full freshmnn worlc also oper^ 
ates to lower their nciulernic status. In any ens-j, it is obvious that 
the effect upon the iutelliKcnce level of the student body of JnveN 
ing the Latin requirement hna not been nt nil an dolorous as the 
Latin enthusiasts were wont to predict. 

TABLE VI. 


COmiKhATION OP TESTS AND (JIIADKS 





Soph, and 

Jvin., 



Proflh- 


Fresh¬ 

Soph, luul 

Jiin.aiul Fouv 

Year 

man 

N'o. 

man 

No, ^^’Csh. 

No. SonUtx' Yeays 

1923 

.43 

146 

.43y^ 

78 .517 

3S 

1924 

.42 

112 

.48 

C5 


1925 

.44 

113 




1021 

.34 

21 

,39 


.48 '/j .48 


PREDICTIVE VALUE OF THE TEST 

Throughout the above discussion, the value of the Thuvstone 
tCct as an indicator of ability has been more or less nssunied, It 
remains to examine its claim more minutely, to determiue the exact 
decree of reliability of the teat in relation to success or faihive 
at Sweet Driuv College, With this object in view, the test scores 
hn\e been correlated with instructors' csUinateSp’ and with academic'- 
fifrnclos for from 1 to 3 years. The tost ratings of sLudunLs drop¬ 
ping out and vcmaining in oach class? bn’vo been compared. A 
number of members of 11123 and 1924 luivo been re-examined with 
on alternative form of the test, Cases nt marked disevepaney be¬ 
tween scores and academic ranks have been carefully ana]y.sccl, and 
the health records of each class scrutini'iiGd far whatevciv light 
they may throw upon the problem, 

'♦'rills ineLliod of testinfr out tlio Rcoros wnw nimiuloiicd on aeconiit of tlie 
illllk-iiUy of Bi'ciii'liifT fiiL‘uUj' uHtlniiitCii of iiilullltfUJico^on nay other biiBla 
ihim thiiv i>£ L^lwKs tt^nvks In LUo iloanrtmcnl Tliu correlation o! 

ma 0v?UimUei4 fov U)‘i;4 ^Ya» only inUnL higher thiia Uiiit fur 

lestti uutl gi'uUeH. 

^Kogei'N, i'Oi)«nilng-lS2 (jQueUer frcfitiiueii, fUulu i\ eiiuveliUldu nf .37Vi for 
the Thorndike tcijta lUid froHJiin/iii tri’mloH (see JiuiraiU of lUlucftLloiml Pfiy- 
chology, Ain'II, 11)20, ii. ISl; 3leii(Ji1 TokIs ns a Alenas of .Sdccting ami Chiysl- 
fyiiig CdlU'Rn Si mien cr). The cdmOiulons hehvmi gi-ndos iind Annj^ Alylm 
iriiorled Xnim Viilo, Ohio, niid SyniciiSG I'lilvL'i’i^UW rouge from ,20 (o Jl- 
foelhcleiitH ju’L* occa&loiijiny ri'porled for speulnl tests. 
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Test Scores and Grade Rank. After trying out and discarding 
various inetnoda of WfMghting, the following procedure 
adopted. The letter grade.s oi ench student for the year were 
converted into numbers (following the scheme A=ll, A^=10, 
etc.) and the total obtained. This total instead of the 
usual average was then made the basis of a grade ranking, and 
coiTClntion coe/Iicients with test rating (based upon adjusted 
score) obtained. Those cooiBcionts (R, calculated by the Spear¬ 
man foot-rule, xLn) are shown in Table VI. The figure for the 
first year grades is about tlie same for all classes, +.43, and ap¬ 
proximates that usually quoted for freshman groups of fairly 
homogeneous material-^ When sophomore and junior grades are 
added, this figure rises to .517 for the 38 surviving members of 
3923, 

A dearer notion of the degree of correspondence (or divergence) 
between teat and grade rankings may be obtained by dividing each 
class into four sections or quartilGs, first on the basis of their test 
ratings, second, upon that of their year's grades. The number of 
students occupying a similar qiiartiie in each set of measures may 
then be compiitod, also the number occupying the highest quartile 
in one and the lowest in the other, h e., the number both of 
coincidences and of absolute di a agreements in rank. E. g., as 
shown in Table VII, 22 individuals out of tho 35 in the highest 
test quartile for 1923 rank also highest in froshma nscholarship; 
14 out of 28 for 1924; 15 out of 28 for 1925, At the same time 
the range of academic achievement for any given degree of test 
performance is wide, and a few individuals from the lowest test 
quartile in each class attain the highest grade quartile, at least 
in their freshman year. The percentage of the group maintaining 
the same quartile rank in both sets of measures is 43 for 1923, 
42 for 1924, 39 for 1920.“ This means that we would be absolutely 
right in the case of about 4 out of 10 studenta in predicting their 
quartile rank in scholarship on the basis of their quartile position 
in test rating; absolutely wrong in the case of only 3 or 4 out 
of 100 (these latter discrepancies being reduced .or eliminated 

when the ranking is based upon the grades of latter years.) 

* 

coi‘rL*«i)aiifIlng- /ig-Ore giv-on hy liye’ors is ojily 35^^. Whether this 
IniliciiLoti Ihc hltflior roliabjllty of our HCtU'us, or the loss yeloctud nad lioino- 
yuiiL'iui-S’ cJuir/Jcter of oiir g-roiii>, L ilobntnblo, 
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TABLE VII. 


QUARTILE COlNGinENCR IN TEST ANI) GuADE RANKINGS 
A. 1923 FRESHMAN GRADES 



IV 


III 

ir 

I 

IV 

22 


7 

6 

2 

TESTS III 

9 


13 

7 

11 

II 

2 


8 

12 

9 

I 

2 


9 

11 

15 

No. Subjects 

35 


37 

35 

37 

Total 





144 

Coincidence 





C2(43fo) 

Disagreement 





4(2.7fo) 

B. 1023 JUNIOR, SOPHOMORE 

AND FRESHMAN 

GRADES 


IV 

HI 

II 

I 

Total 

IV 

5 

5 

0 

0 

10 

TESTS in 

2 

1 

G 

4 

13 

II 

1 

3 

3 

1 

8 

I 

1 

1 

1 

4 

7 

Total 





38 

Coincidence 





13(34%)'^ 

Diaagi'eemcnt 





1 


C, 1924 FRESHMAN GRADES 




IV 


HI 

ir 

I 

IV 

14 


8 

6 

2 

TESTS III 

5 


11 

7 

5 

II 

8 


4 

8 

7 

I 

1 


5 

8 

14 

No. Subjects 

28 


28 

28 

28 

Total 





112 

Coincidence 





47<42%) 

Disagreement 





3(2.6%) 


D. 192D FRESHMAN GRADES 




IV 


III 

II 

1 

IV 

16 


7 

4 

2 

TESTS XII 

5 


9 

9 

G 

II 

4 


10 

7 

8 

I 

4 


4 

6 

13 

No, Subjects 

28 


30 

2G 

29 

Total 





113 

Coincidence 





44(39%) 

Disagreement 





0(6%) 


•Bnlfici] to Wh Avlion Mic lost fiujirtJloa are Giiiiiillficc], on tlio IjjisIs of 
the 3a remnlnliJir nicmbors of Llic class. 



270 


!• liESRMAN TESTS IN THE SMALL COLLEGE 


E. 1921 FOUR YEARS GRADES 


IV 


IV 2 

TESTS III 2 

II 0 

I 1 


Total 

Coincidence 

Disagreement 


III II I 

0 2 1 

3 0 0 

13 1 

10 4 

21 

12(57%) 

2(9,5%) 


Foi' the test ranking of those delinquent in studies at the end 
of the freshman year, also of significance hero, see Table XI. For 
a corresponding group Thurstone reports delinquents to the num¬ 
ber of 0, 2, 3 and 0, for the test quartiles 4 to 1. 

IVhat is the real significance of thc.se figures? Can a test whicli 
yields a correlation coeHicicnL of less than ,80, a percentage 
quartilc coincidence with grades of loss than 75, be of utility in 
ji college oificc, either in the guidance or climinaLon of students? 
Should material or method be modified, or is the quest hopeless ? 

In answering this question, the iiecos.siLy must first of all be 
eznphasized of considering the grades for the entire college career 
of the student before passing judgment upon the test as prognostic 
of academic achievement, Grades, always tricky, are specially 
open to attack in the freshman year. First of all, tlierc is the 
{allibilUif of the uifitriictor, possibly too easily impressed by n glib 
memory, poise of manner, a fiuent tongue. Second, the rfu-io.jicc in 
vavking iiUnidards in difTerent departments, illustrated by the fact 
that the median freshman grade in the various subjects ranges 
from C minus to C plus for 1924, from C plus to B minus for 1925 
(C=rair, D=Conclitioned, B=Good) ; while the middle point in one 
subject rose from C minus in 1920-21 to B minus in 1921-22, 
Third, owing to a certain latitude of choice m subjects^ even in the 
freshman year, deceptively high records may be achieved by 
students doing very little real brain woi'k; especially in the case of 
courses based upon material already familiar to the well-prepared 
student. 

There is also to be considered the routine character of maivj 
freshman cou?'seSf involving on the whole more of a memory grind 
in grammar, formulae, and fact, than later, more advanced, and 
elective studies, which arc pcj* se better fitted to evoke veal reason¬ 
ing ability and initiative in the student. Lastly, from ibe poiiit 
of view of the individuzd freshman, there is the chaotic character 
of the first year in college, involving as it does adjustments to a 
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novel envii’oninent, collision of social and intellectunl ambitions, 
us well as submission to a move or less arbitrarily imposed curri¬ 
culum, in which the special bent of the individual may be ignored 
or thwarted. All these factors conspire to lower the value of 
freshman grades as prognostic of future academic success, and to 
prevent the individual student from finding her true level in the 
freshman yeavi An easy schedvilc or aingle-inindcd industry may 
run up a record unduly; the reverse factors lower it. 

Even, however, when the upper class records arc at hand, the 
indications are Ihal the coiTGhitions will liardly rise higher than 
.60 or ,70. Is this to be ascribed to the shortcomings of this par¬ 
ticular test, or is it inevitable in all mental testing of college 
women, representing a comparatively narrow range of abilities 
and subject to certain other peculiar conditions? It is a matter 
of common knowledge that inniiy factors apart from intelligence 
enter into the determination of academic success. Health, «ambi- 
tion, habits of industry, social distraction and diversion, worry 
and other causes may tip the scales one way or the other, la it 
not likely, particularly in the case of a group of women, working 
less under the spur of strenuous vocational motives than do men, 
that the serviceability of any mental test is necessarily limited? 

of Cases o/ il/arfeed BiHcreimnc]) between Test Scores 
and Academic Rank^ In order to apportion the blame between 
grades and tests, and determine if possible how far the test itsoif 
stands in need of alteration (in subject-matter, method of udinin- 
istering, or scoring, duration, etc.) a number of cases of marked 
dislocation between academic I'ating and test scores were selected 
for further stiidy^ Twenty-three of these, along with a sprinkling 
of seven others to act as a control—to the number of 30 in all 
for the classes of 1923 and 1924—were re-examined in March 
1921 with alternative forms of the test blank. Secondly, a number 
of facts were collected and tabulated (see Tables VIII and IX) 
with regard to all freshman in whom the amount of dislocation 
is equivalent to at least % of the total range of rank for the 
group (representing nearly a quarter of each class.) 

A considerable amount of the divergence between the two sets 
of ratings proceeds undoubtedly from in adequacies in grade 
ratings, the shortcomings of which, especially in relation to the 
freshman curriculum, have been already commented upon. As 
shown by the table, when sophomore grades are substituted for 
freshman, the discrepancy with test ratings is materially re¬ 
duced; as a matter of fact, in three quarters of nil such cases re¬ 
maining in college. Cases of apparent overestimation by the test, 
rise on the average 2 deciles in grade rank; cases of underesti¬ 
mation drop 3 deciles. 
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Ntivcrtheksa, certain of the total number of cases in which the 
Rtudent's acndemic record exceeds the promise of her test per- 
formance, are probably bona fide instances of underGstimation by 
the testa. Seven out of ten of such cases when retested rose 
several deciles in rank (although in the majority of control cases 
there was little change); and there is every reason to believe that 
the second teatinir yields the truer measure of their real abilitv. 
Various familiar strictures as to the fallibility of test data seem 
to be here substantiated—notably the objection that a low score 
may be a function not of native stupidityj but of lack of training, 
of poise, self-control or self-knowledge, nianifesting itself as nerv¬ 
ousness, flightiness, poor judgment as to the best balance to strike 
between speed and accuracy, exags’erated confidence or undue 
enution. Further, a scrutiny of the health records indicates that 
a certain number of the cases of discrepancy studied were laboring 
under some more or less temporary physical handicap, such as 
recovery from a recent operation, which invalidated the earlier 
testing. 

In cases of apparent overeatimcLtion by the tests, the health factor 
enters also, though in a dilYerent fashion. At least half ol the 
individuals in 1D2'1 and 192G whose grades fall seriously below 
expectation (If) out of the 30), and practically all whose sophomore 
standing shows no improvement, have poor health records; while, 
on the other hand, the majority of cases in the class of 1926 in 
which the grade rating is surprisingly high have excellent health 
records. There is undoubtedly ii fiiiick nervous type of individual, 
capable of running up a high score in a half hour test, but lacldng 
the physical stamina (and with it the ambition), for the sustained 
effort essential to a brilliant academic career. In auch cases, the 
high test score may sometimes be utilized to arouse dormant ambi¬ 
tion, but the wisdom of so doing is often questionable; and such 
individuals are frequently outdistanced by classmates ol mediocre 
Ability but superior nervous and physical endurance. 

While the uncertainty and variability both of health factors and 
mental attitude complicate thus the exact prognosis of academic 
success or failure from this or any similar test, certain devices 
are available for increasing the reliability of test findings. Pains 
should be taken to stress the importance of the test results to the 
individual (without creating undue tension); to defer the test 
period, in case of the physically unfit; and to repeat the test (in 
alternative form) a month or more later, at least for those occupy¬ 
ing the lowest test deciles. Some more exact adjustment with 
regard to the inclusion of accuracy in the teat score, or the weight¬ 
ing of errors, is also desirable. Something might also be gained 
by the supplementary use of a will test such as Downey's or a 



MUlurAY 


man- cninpk'U^ vveuvtl. 

TAIJLK Vni. 


1Mscr::(*ancii:u IUitwkkn 

Ti:.yr 

AND 

Giiadk 

ILvi'iNuy 


Chis.H 

; of 

1112 

i. 

n 

Im 

1921 

V i. 

192B 

Grade Ranking* 




71 


.If 


Number of Subjects 


H) 

]\) 

lb 

Th 


12 

Median Ago 


18.2 

17.8 

18.1 

18.2 

18.2 

id.i 

Health Poor 




r> 

10 

n 

c 

Freshman C'ovivse Vhmy 


in 

K 

d 

10 



Left Before Sophtunoi'c 

Year 


U 

2 

8 

5 

G 

Soph. Gvadi* Ruling Nearer Test 

11 

7 

(1 

n 



Accuracy Rating Nearer 

Grade 

10 

U 

r> 

10 

9 

6 

No, Rcle.sted 


7 

n 

2 

2 



Retested Nearer Grade 

Decile 

d 

2 

2 





Total H8 28 29 

'^.Vs ('i>iitniiir*ii willi Tv^t 


TABI.K IX. 
UKHULTy nr Rm:yTiN(; 


Class of 

1922 

1924 

Total 

No. Retested 

If) 

14 

30 

Cases Discrei)ancy between Te.st and Grade 

12 

10 

23 

Control Cases 

2 

4 

7 

Second Test Ranking Nearer Grade Hecile 

Av, Decllo IIaviation of FrGHliinau Grades from 

r» 

5 

11 

Test 1 Rntmg 

Av, Decile Deviation of Freshman Graclc.s from 

4.0 

4 


Test II Rating 

3.0 

3.3 



Av. Pocilo Tk?viaLion of Soplionioiv fivnn 

Test I Rntbig 2.8 

Av. Drcilc Devintion of Soplumioro jjrades from 

Test II Rating 2,9 

II may be, a^lclcil that tbc factor of nRc, ov vathev, that of 
youth, nocms also to comp He ate our rcKults in a fn.shion not c]uitci 
d'^ciphernblc. There is ii tendency to an inverse relation between 
age and tost rank, a direct one between a?^e and f^rades, The 
precocious niiud tests hif?h, but a certain matiirity of experience 
and purpose as well as of mentality is apparently desirable in 
order that higher studies shall be ussiinilated in their full value, 
and sLuclioua huMts set up. The weight of evidence is uKainat 
lowering the age limit. 

Test and G?'«f2c Rank of Withdrmoalti, 

Another criterion of the academic value of test .scores is aoinc- 
limes sought in an analysis of the cases of wiLluh'awal. For 
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S^veeL Di’ku' students, the distribution of the Josses (shown in 
TabJe X) is fnirly uniform over all the test deciles, except in the 
cflSG of 1923, for which class, the mortality in the lowest decile is 
coiispiciiQUsly greater than that in the highest. Again, the loss of 
sbudcnLa from the upper half of the teat ranks is only slightly leas 
than that from the lower—roughly as 6 to G for 1923, and almost 
1 to 1 for the two Inter do sacs. Obviously test ranking cannot bo 
used ut Sweet Briiir to forecast the probability of withdrawal as 
Suggested by T burs tone. Thai tins is not, however, to be inter¬ 
preted us pej- ,90 a rcllection upon the reliability of to it rating:. Is 
indicaU’d by the second half ol Table X; th^ proportion of tjtal 
losses for the upper grade deciles practically parallels that for 
tho upper test clGciles—except in the. case of 1926, where the record 
is as yet incomplete. 


TABLE X 

TEST AND GRADE RANK OP WITHDRAWALS 


Year 


TKSr UAMv* 
1923 

1024 


1925 




(164) 

lyr 


(lltJ) 


(116)** 


7 

C 

X 



7 

a 

ft 

Ui 

r-i 

7 

u 

c* 

u: 

lOLb docile 

2 

5 

1 

8 

4 

4 

8 

4 

1 

1st decile 

10 

3 

2 

15 

4 

4 

8 

B 

3 

Above median 

20 

26 

3 

54 

25 

13 

38 

17 

9 

Below median 

36 

23 

4 

C3 

20 

17 

37 

17 

8 


_ _ _ 

— 

— 

— 

— 

— 

— 

— 

— 

Total 

62 

48 

7 

117 

45 

30 

76 

34 

17 



UllADK 

l[)23 

HANK 


1924 


192B 



(146) 



(112) 


(113) 

10th decile 

3 

3 

1 

7 

2 

4 

6 

3 

0 

1st decile 

14 

1 

1 

IG 

18 

2 

10 

7 

1 

Above median 

24 

24 

2 

50 

17 

17 

34 

15 

6 

Below median 

35 

20 

4 

59 

24 

13 

37 

16 

11 


_ 

_ 

— 

— 


— 

— 


— ■ 

Total 

59 

44 

6 

109 

41 

30 

71 

31 

IT 

jji-imn>Jrl p. 

iKiciiis 1'o^^isii‘i‘iiip 111 

in 1(1-y 

(‘lU’H 

iiiv iiu'ludi'il 

In I1 Uh 

tiihio. 
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1 


/I 

11 

lU] 


7 

J2 
-I 
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2 

3 

9 

U 
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‘ Pt‘ciahs<;(i coxir.sc.s, („• a whh,, ^niances, desire for 

sninller collc^ro ^wJ n •"'! '■'■ ‘««t<l"tions. In 

j« (loli|,t.inlp iMlonii,,,, „r rrmiiiniii'J f.-ushtunn ontor with 

J<='Jo of the clans of Itw; S ‘ 1«22, of tl,c Icnvont teet 
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wntcrinl is .slighL Grtintcd the precaution of a second testing, a 
dead line for admission might bo drawn not merely at the 10 but 
even at the 2D percentile—a score of about 72 correct and 73% 
accuracy (in terms of the recorcls of 1923 at Sweet Briar, for the 
1919 edilion), or belLor, at an adjusted score of 41 Where it is 
not deemed feasible to rLsk the reduction of the freshinmi class in 
this fnsliion, it would at least be desirable to encourage by every 
means available the students of Iho upper quartile^ to discourage 
the return at the end of the freshmun year of the students of the 
lowest Judging by the correlations and other data this course 
would in tliG end prove more satisfactory than merely scalcing the 
withdrawal of the student of the lowest (jradc decile or ciuartild 
The question of the suitubility of the component elements of the 
two editions of the Thurstonc tost for our particular task, and the 
value of each relative to the different branches of the curriculum, 
is reserved for discussion in another place. 



PREDICTION FORMULAE FOR TEAMS OF APTI¬ 
TUDE TESTS 


By Cr-AKK h. IIOIJ. 

UwWei'feity of Wisconsin 

I 

The rnpid Qflvance in tlic! practical npplit^ntion of tests to tlie 
pi'Gcliction of aptitiiflos, promises soon to l)rinff into i^eiicral uso 
scientific prediction rormulae. Willi the paMsiinr over of tliis im¬ 
port ant branch of test technique from the theorcUcal to the prac¬ 
tical, comes a rc-cxaininatioii of the properties of the regression 
eciun(-''m, n'w gciir-'cMy accepted as the sLandanl predicliini forni- 
wbi It 13 th?. chief object of UiC present article to point gut certain 
practical diHlciiltics associated wtih tlic use of the regression 
equation for this purpose, and to propose a remedy. 

Suppose the employment department of nn industry has two 
jobs for each of which n team of tests 1ms been devised nnd each 
tcniii provided with un appropriate regression equation. Let it he 
furthu * sLiprosrd that this eniployinont department has been in the 
habit of rating its employees on a simple uniform scale such that 
the worst man in a hundred is scored zero, nnd the best scored 10, 
with the mean at 5; and that tho diagnostic potency of the first 
team of tests (B) is .GO while that of the second is ,40. Now if 
such an employment department should begin to use its tests and 
regression equations in the prediction of nplitiulcs of prospective 
employees and with exactly the same grade of men os previously 
employed, it would find that the highest pr die led score ever oh- 
tnined with the first equation would be 8, and the highest with the 
secerd only 7, iiirte-'cl of the V) io which iL I'd bec i acciis'omcJ. 
If the empolyment deportment had been in the habit of cl is charg¬ 
ing all employeeg known to he below score 2 in aptitude and had 
planned on rejecting all applicants who were indicated by the 
tests as probably below this level, it would find to its surprise that 
the first equation would predict none at nil below 2, and the 
second none below 31 The ociuabiona would tluia indicate no ap¬ 
plicants as being either very bad or very good. If the employ¬ 
ment department should desire to reject the lowest 25% of all 
applicants, it would have to select a radically different score from 
the score marking the lowest 25% of its actunl employees, Not 
only this but it would have to select a distinctly different score to 
accomplish this with each of the two -regression equations. Or, 
to Gonaidcr the matter from the point of view of the order of 
merit, a predicted score of G by the first team of testa corresponds 
tc a rank of tenih from the best in a hundred, whereas the same 
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score with the second- team corresponds to n rank of third from 
the best in a hundred. 

Now the cause of all this confusioii-lies in the fact that regrea- 
.sion cquntioji.y Jinve nu ineviLable and usually radical tendency to 
narrow the range of distribution of predicted scores as compared 
with that of the original criterion. This is at once evident from 
an inspection of the basic regression oquatioiV 

(T . 

x=v—y .( 1 ) 

when it Is i'ec«ullod that r is ahvnys less than unity. The operation 
of this timdency in the case of nniltiple corr,elation may be sherwn 
by means of the following miniatiirG problem, which will also 
serve to illustrate certain other principles to be brought forward 
later. The original data of the problem are given in Table I, 
together with the rcsi:ilt.s of the necessary preliminary computa¬ 
tions for the regression equation. 

TABLE I 


Subj. 

Criterion 

Test A 

TgsIB 

Correlations 

Partial S.D.'s 


(1) 

(2) 

(3) 



I 

2 

8 

8 

r,,=+.G2B 


II 

4 

6 

5 

1*13^“'1" .5626 

S. 0.1,31=2.78 

III 

G 

7 

2 

r33=+.376 

S, D,2tis,^1.66' 

IV 

1,8 

!) 

14 



V 

10 

11 

6 

r„.i=-h.B42 


Mean 

7 

8 

7 

rij,v=+,4B2 


S. D. 

4 

2 

4 




Dropping the smaller decimal a, the primary regression equEi' 
tion on this criterion is, 

x,=^M8K^-\-,mx, .( 2 ) 

where the x’s are the deviations of the individual subjects' scores 
from the means of the separate arrays. Subs Li til Ling in this to ob¬ 
tain an equation in which actual lest scores may be used for pur, 


poses of predictioiij 

X,-7=.9G8(x.-8)-h.381(Xn-7) .(3) 

Clearing and collecting, wc obtain, 

Xi=.968X.+.38lX.-3.41 .(4) 


where the X's represent acLual scores. This is the form of the 
regression equation ordinarily used for purposes of prediction. 

‘Ynlp, 0, It; Jnli'fuJuttiun tu Ihc Theory of 171. 
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SubstLtutine in equation (4) the test scores of each subject 
shown in Table I, we obtain by successive application, the follow¬ 
ing: ''predictions'': 


Subject 

Predicted 


score 

I 

7,38 

II 

3.33 

HI 

4.13 

lY 

lO.Crl 

V 

9.G2 

Mean 

7.00 

S.D, 

2.877 


These predicted scores correlate with the criterion to the extent 
of d-,719. The mean of the predicted scores is seen to be, as always, 
the snm-a as that of the criterion, 7» It will be noted, however, 
that the S. D., as would be expected from the nature of the re¬ 
gression equation* is much loss than that of the criterion, being 
only 2.877 as agaiirit J. This is what caused llio cciufusion noted 
above, 

II 

As inclicntod by equation (1) the amount of shrink a go in the 
dispersion of the predicted scores is dependent upon Die size of r. 
In cases of niidliple correlation such as the jiroscnL whore we 
have a predicted criterion derived from n set of weighted teati^, 
the shrinkage in dispersion is dependenL upon the size of th cor¬ 
relation between the predicted and the actual criterion scores. Yule 
has dosignalcd this correlation us Thus in Iho above example, 
if the S, D. of the criterion (which is 4) be multiplied by U (.719), 
the result will be 2.877, which is identical with the S. D. of the 
predicted scores as obtained by actual computation. Knowing this 
relation then, we may write the formula, 

X,=:cbi2. sXa+cbi 3 ,2X3 ...( B ) 

where 

1 

R 

and all of the other symbols are the same as emidoyecl by Yule. 
This formula, while leaving the correlation between the tests and 
the criterion undisturbed, yields a prediction series with exactly the 
same meon and degree of disperaion as the criterion itself, thus 
eliminating the objectionable features of the regression equation 
noted above. It is accordingly proposed for uae in vocational and 
employment prognosis. 

ul oTod. clL V. ' 
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In detcrmininK K, it may be recnllcd that it is not necessary 
acKunlly to make the predictions and then compute the correlation 
between prediction and criterion as above, in order to hnd R for 
use in fornuiLa (6). U may be found very readily by formulae of 
the following Lypei^ 

l-(j (.(6) 

Substituting appropriately in o^pintion (G) from the values given 
in Table I, 

Ri ,53^ v' M1-762 G^K l^Ari2^ 
rn .711) 

This agrees exactly with the r computed from the predicted and 
the original criterion scores in the ordinary manner. 

The operation of the proposed prediction formula (6) may be 
illustrated by moans of the example already consideml. Substi^ 
til till g tile value o£ II in the formula for c* 

1 


,719 

=1.391 

Substituting the value of both c and b in formula (5), 

Xi = 1,391 X ,968 X, H- 1,391 X .381 

xj X. 1- ,S30 ..(7) 

Efjnation (7) is analogous to LMiiiation (2) above. From here on, 
the procedure is oxaclly lilcc 111 at with an ordinary regression- 
equation. *5nbstitilting tho values of fclie means as in equation 
(3) ami solving, we have, 

X, r=r IMC) K, -f- ,rm Xi - 7.468 .:. (8) 

Substituting the tost scores of the various subjects in (8) as was 
done in (d), the folIowiiiB' predictions arc obtained; 


Subject 

Predicted 

Score 

I 

7,620 

ir 

1.844 

III 

3.007 

IV 

12.051 

V 

10.506 

Mean 

e,087 

S. D, 

3.096 


R— .7X9 


(7, 

(4) 

It will bo observed that in this prediction, not only the mean is 
the same as that of the original criterion, but that the standard 
deviation is also the same. The shrinkage in the dispersion of 
the predicted scores caused by the regression equation has been 
corrected by the prediction formula (5), and the standard devia- 
Wule, oiVTcI tT^nrisi ^ 
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tion restored bo its ori^iiinl size of 4. The correlation is entirely 
undisLurbQd, stundnig at .719 exactly iih before. 

It is to be noted blmC the proffnosi.s foxniula employed above 
is not itself a regression equation. The true nuiUipIc roKre.ssion 
equation serves two distinct functions. One function is to give 
the weight that each teat score ahould be nuiltiplicd by, that all 
eombiiied’shall yield the maximum coiTolntion with the criterion, 
rnnumcrable such optimal weightings arc possible, since all that 
is necessary for this is that a certain optimal proportion shall 
be maintained among the \Ycights given to the various tests. 
The second function of the regression equation is to indicate 
the pnrticulnr set of optimal weights that, when tlic tosL scorca 
are multiplied by them and combined, they will yield tlie most 
]>robable ahaohtie criterion score obtainahlc from the data. The 
proposed formula performs the first funcLion but not the .second. 

To give the most probable absolute criterion .score, the rcgrc.S' 
sion equation mu.st always reduce iiioro or los.s exLcn.sivcly the 
disper,sion of the predicted scores below that of tlie criterion 
aimed at. This introduces nn element o£ uncertainty into their 
use for employment purposes, very much like what would happen 
if predictions were to he made on a now and unfamiliar scale. 
Thus with a basic 10-point scale, Llic maximum possible pre* 
dieted score may vary from 6 or so, up to above 9. Pot this rea¬ 
son a predicted score of 6.5, any, has little meaning when applied 
to an individual subject. It may mean that he is probably only 
slightly above the average applicant in aptitude, or it may mean 
that he la probably the one best appUcant in a hundred. The 
predicted score, standing alone, gives ua no light whatever as 
to which of these two extremes is more nearly approached, Un¬ 
fortunately this is exactly what the employer wishes to know 
from a team of tests. By restoring nil predicted di.spcrsion.s to 
the size of the standard criterion aimed at, the proposed formula 
eliminates this ambiguity. 

It is also easy to show that, in spite of the fact that the 
regression equation yields the most probable absolute predicted 
score, its ordinary use in employment may lead to unfortunate 
results, Let us revert to the employment situation instanced 
above (Sec. I), Suppose the labor market to be such that it is 
necessary to hire practically all applicants, the two teams of tests 
being used merely to decide in which of the two jobs n given 
applicant probably hag the greater aptitude. Let it bo further 
supposed that aptitude in the two jobs is positively correlated. 
One result would be that men of fairly equal but low ability oji 
both jobs would tend to score higher on the second job, since 
the low R of this team of tests tends to raise all low scores 
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towards tha mean, thus tending avtificiaUy to shunt the poor 
workers into the second job. On the other hand, subjects having 
relatively equal but high aptitude for the two jobs ^vill tend to 
score iower on the second team of tests because the low R in 
thifl case has lowered towards the ?nea?i predictions from all liigh 
scores^ thua tending artificially to shunt the good workipen oitt 
of tliG second job. As a result of this there will be a tendency 
for the poor workmen to be segregated on the second job and 
for the better workmen to be Hogregated on the first job. Bub 
with the proposed prognosis formula, since the range of predic¬ 
tion would be exactly the same for both teams of tests, the un¬ 
fortunate tendency noted above could not take place. It would 
still be truO; of course, that the predictions made from the team 
of testa with the weaker II would be less accurate than those made 
from that with the stronger It. 

Ill 

It will not infrequently happen that the original unit of meas¬ 
urement of a criterion will be such as Would be undesirable for 
use in prediction. For example, the original criterion of the 
cffLcicncy of lathe workers might be a set of careful micrometer 
rend Inga slio^ving the deviations from specifications of certain 
products turned out by the subjects. Obviously such a criteriah,. 
while probably excellent from the point of view of reliability, 
would hardly be sufficiently intelligible for general use in the 
prediction of aptitudes*, 

A special need to make predictions in terms other than those 
of the original criterion measurement will aviso where it is de- 
Bived to predict the aptitude of a person on a number of different 
vocations for purposes of comparison, with n view of determining 
in which be is most likely to succeed. Such comparative predic¬ 
tions, it would seem, must become very general if scieiiufie voca¬ 
tional guidance is to become a reality. To be readily comparable, such 
predictions should all be made in tarms of the units of some 
simple uniform scale, e. g- one of ten points. This scale will 
ordinarily not (except by chance) be the same as that of the 
Old gin a I criterion mensuremenL For such cases the following 
method has been derived by means of which predictions may be 
made in terms of scales having any desired means and any de¬ 
sired standard deviations, quite irrespective of what the corre- 

<A riinu'r ooimmm form of tills tlllHoiiUy roauli'Vn{? mic-olul trofttiiu-nt la 
whoi-o, iia so ufloii linrpfms, lUo only aviillulilo rrUorUm Is i\ soL of ninks of 
tlio Ui tin- uf'llvUy slutllorl. UaaUs xirt; not only iinsiUlsfnelory 

unUfi fur iniriiosos of iiroilirllon, buL sWiilllcinU I’OtjiTSsion (■<!mil ions cnii- 
noL bo bfiBCil upon Dioni. For sncli cuhoh, ii iiictliort of coiivorUiiR ninkB 
into lliionr unliH couvonloiU for iiui'iiokoh of ihciHuLIou nnd udou 'ivlilcli 
TVigvosnUm wuy busoU, ts tioscylUod tu tUln xfoaviml Vob Yl. 

nn, fr. 
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fiponding values of the original criterion scales may have been. 

The procedure is first to v^ork out the primary regression 
equation on the basis of the origiiinl criterion measurement ex¬ 
actly na in (2) above. Then if we let be the S. D. of the 
original criterion scores, and^i’ ho the S. D. of the scores to bo 
predicted on the desired scale by the prediction formula, we may 
wi’ite, 

c =. .(9) 

Il<r, 

This value of c is substituted in equation (5). Lastly the mean 
of the desired prediction series is used in place of that of the 
criterion series when the x-values are converted into X-values 
aa in equation (3) above. 

The concrete working of the method may be illustrated by trans¬ 
forming equation (B) into one which will predict in terms of a 
10-point scale with the mean at G aiul with a S. D, of 2- Sub¬ 
stituting the appropriate values in (9), 

2 

^ = -i - 

.719X-1 
= ,698 

Substituting the value of c in equation (5) and solving we have, 

xi = .0729 Xa d- .2649X3 .(10) 

Substituting in (10) the vnlue.s of the means na in (3) above ex¬ 
cept that here B (the desired mean of the new predicted scries) 
I'cpUcea the 7 cf the ovvglwevl evitevien scries, vjc have, 
xi - 5 = .6729 (x, ^ 8) H’ .2649 (x, - 7) 

Clearing and combining, 

xi — .6729X. + .2649x3 - 2.2375 .(U) 

This is the formula that we have been seeking* 

Lastly by substituting the test scores of Table I in formula 
(11) we obtain the following predictions, this time in terms of the 


desired 10-point scale: 

'‘Predicted’^ 

Subject 

Score 

I 

5,266 

II 

2.463 

III ■ 

3.003 

IV 

7.528 r =: .719 

V 

6.763 

Mean 

5.000 

S. D. 

2.000 

It will be observed that 

the prediction yielded the required mean 
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t\ncl stancbrJ deviation, and that the correlation is tindia- 
turbed 

The same results as secured above may be obtained quite 
simply by converting: the undesirable criterion scores into the 
desired prediction scale before the zero order correlations are 
comimted. This nmy be pcrfoiincd with ease and precision by a 
method described in this Journal, Vol, VI (p. 298 ff.) 

In case it should be desired to predict in terms of a scale 
di/Tercnt from that of the original criterion but by means of a 
true re(?ressioii equation instead of the prediction formula ree- 
oiiiJiicnded above, the procedure is exactly the same as that just 
described, except that in this ease, 

(fi 



labor turnover and metal alertness 
TEST scores 

By a. J, Snow 
NorthwestehN University 

That labor txirnovGr is an ever prcisent problem anil a costly one 
to the industrial institutions tlmt harbor it and to the community 
generally is admitted by students. Some industrinl managers fully 
realize the waste involved in the maintenance of an unnecQHsarily 
large labor turnover; if there is any one who doubts it, it is that 
group of omptoyers who do not possess Lhc capacity to move along 
mentally in the realm o£ industrial relations with the constant in¬ 
dustrial expansion. It is well known that tliia larger group, com¬ 
posed mainly of inefficient and dogmatic employers, la the 
greatest single obstacle in eliminating this form of social Waste. 
That this group of men is nhvays willing to assert tlioii suverior 
and infallible knowledge in handling employees, is an ever present 
experience of the student in this field, and that they have almost 
complctey failed in dealing with this problem a a well as wtb the 
other problems of Indus trial relations, wo have proof of in the 
increasing industrial uiiresL. 

Labor turnover is not only an industrial problem, but directly 
a social and community problem, this can be seen when we realize 
that waste In any form ndda to the actual cost of production, which 
ia paid cxcntually by the comniuniby of consumers. To point out 
only five of the many items which aro chargeable to this form of 
preventable waste, from, the point of view of management, we have 
the following: first, expense iiicident to employing; second, instruct 
tion to the new employee by the foreman; third, spoiled work be¬ 
cause of new surroundings, new tools, etc.; tlie Hainc ia true of the 
fourth factor,^—breakage of tools and machinery; fifth, decreased 
production due to the temporary low production of new help. From 
the point of view of the ill-plncod employee, we enn enumerate the 
following three factors: first, loss in wages incident to the change 
of Jobs; second, decrease in earnings due to the period of adapta¬ 
bility to the new job; third, decrease in earnings duo to mia- 
placement, 

It has been known to industrial psychologists, some of the movo 
enlightened employers and a handful of economists tliat wages, 
and working hours are not the only industrial problems; in fact, 
wages and hours, ns an incentive, are subordinate, or, at most, 
on a level with the control and distribution of power within, an 
industrial organization. All that one hna to do to verify this 
hypotliesia ia to estimate the number, magnitude and importance 



LABOR TUUNOVEU AND MENTAL ALERTNESS 2S6 

o£ disputes over the distribution ol pov/er as compared to that 
of wapes and Jiours in any industrial court of arbilraiion of long 
standing, such as the industrial court in the clothing industry* 
The eairiG may bo said of our present problem—^labor turnover, 
The casual observer is certain that the most responsible factor 
for an abnormal labor Liirnover Ls the worlcer’s dissatisfaction 
with his wage. The stiulenl of the subject knows, however, that 
dissaLisfaclio?! with wages will not alone induce the worker to 
change his job, much less to give it up with the ever-looming 
possibility of unemployment. Most human beings must feel that 
tho change will be beneficial in more ways Limn one. As a rule 
there arc a number of factors contributing to the worker’s de¬ 
cision to leave, and some of these may very well be of the foL 
lowing nature: abuse of power—perhaps the greatest soui'ce of 
dissatisfaction—wages, hours, unsanitai'y conditioins, arbitrary 
ftdvanCGineni policy, lack of instruction, faulty machinery or toola, 
heterogeneous "consciousness of kind" among team workers, 
personal incompatibility with immediate supeidors, lack of stan¬ 
dard) 5icd methods of process, lack of ins I ruction, lack of spe¬ 
cialized ti'aining on the part of the worker, economic insecurity, 
physical incapacity, mental incapacity and a mentality too great 
for its task, 

Statistics are unfortunately lacking as regards the comparative 
importance of most of these various factors. However, some 
interesting data has recently been gathered in connection with 
the two last factors. While admitting the danger of any study 
which aims to dissociate any one factor from its immediate sur¬ 
roundings, nevertheless, such n study may be justified on the 
grounds of its illuminating results and their actual usg, when 
other factors composing the complete situation are given due 
weight. Consequently, the statistical study as to the relation of 
mental alertness and labor turnover that ia to follow must not 
be given undue prominence in the mind of the student of the 
generol and wider problem of labor tiumover. 

The Scott Compuny has found the following tendency in their 
practical application of psychological methods to industrial man¬ 
agement—that, when all of the men in any organization, excluding 
major and minor executives, are given the Scott Company Mental 
Alertness Test’, the score so obtained tends on the .iverage to 

■Mosl ps?yclioloir<stH rpooeiiisc**, uml rigliUy no, a tleeislvo iluroraneu 
Uvoeii iut^i\Uvl uk^vUWKS ami U\U‘lUy:o«ca, ulnrlnoHs ht'hii^ only ono 

Ciicior [n Iiuulll|ii)nc( 2 , Sec, o. (iiuUt, i^ociai P«j/r/io/a//i/ (Holt, \\ 77, 
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change with the worker's occwpatioiial p:vovlp^ This tcmleney 
would suggest that a worker's place in an occupation which de¬ 
mands higher capacity for alertness than he is capable of would 
become either dissatisfied with his abnormally alow progress or 
would ho discharged for incompetency, On the other hand, a 
worker of higher alertness capacity than is demanded by hia 
present occupation, if not rapidly promoted into another field of 
endeavor where a higher level of alertness is necessary, will 
become dissatisfied and leave for a more promising job. The 
worker fniying in this latter class is, of course, very valuable to 
an industrial enterprise and the knowledge of his capacity in 
mental alertness would tend to save him for that industry which 
gives due weight to such information in their promotion and 
training policy. 

The following two experiments made by the Scott Company 
yield illuminating data, The first one was n study of the relation 
of the number of years each man was retarded at the time of 
leaving school—os an index of mental alertnc.ss—as related to 
the stability of the working force in several production depart¬ 
ments of a manufacturing company. In this study there has been 
found a striking difference between departments, e. g., in the tool 
department where the work is of a high grade and varied, "the 
greatest proportion of dissatisfaction occurs among the workers 
who were most retarded in school. The stability increases as the 
amount of retardation lessens. , . While in Lho inspection 

department of the same company, where the work is repetitive, 
monotonous and 'fool-proof' “the amount of dissatisfaction is 
low for .those men who were very retarded in schooL The per¬ 
centage of dissatisfaction increases markedly until, for those 
whose progress in school was normal. , . 

The second study dealt with relationship of mental alertness 
test scores and labor turnover. The psychological test used was 
the Scott Company Mental Alertness Tests.' Tliis study has been 

^All oT the rresliiiK'n nt NorClnvPHtcim UiilvorsUy Inu! to tak« the Sentt 
Coinpnny Mentnl Alcvtiiiiss Test. It Iiah luion found thtit nftor tlio Inn so 
of ono BeiiiGstor tlint nil of tlie frcsliinen tlint scored in the unpor fiiie-thlrtl Iti 
iiicntnl filertncsa teBta U(l.3 per oent ear nod n ffrutU*. which if avornBcd 
nirnughont tlioir college career, would onnhle them to I'liidualc. Of the 
frealinicii who scoml In tlio lowest one'tlilrii In the mental (UerineHH tests, 
only per cent secured I he necessary grndo for priulmuion, Z’’rc‘shiiian 
whose lilgh school scholnralilp would place Llu'in In the finirlh (iiuirter, and 
who were UflniUtcd to LUe riilvei'BUy on sceuvlng the medium or ahuve lu 
the nieulnl alertneari tosls, only 10,0 per cent recedved the pradc iit tlie end 
of the first seniesLcr, wlilch If Kept up, would oimi>le tliciii Id Bradnnte. 
(riio data for this note was secured from Mr. Paul Lester Palmer, Nortli- 

^Scott nnd Hayes yc/c;rcc ond Common ^I'cu.sc /a Wurkinff with Men (Ronald 
1 rows, 1 W 21 ). p, T.", Fnr a full account .sen also pj). 72-'‘J.M, mifl tlie ,Scolt 
Cninpany Lahoratovy lUilletin L. No. ;i, August 3U, 1020. This hiillctln la not 
pvvhnsUed inat nihneOBrnphod; the Rnino Is I rue of the luilleLliiH reterrod to 
below. 

n’rluted, not piihllslKfd by Che Scott Company, Phllndelphln, Pn. 
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made upon the cmployeea of three different compfinies. For the 
isnkc of convenience we shall designate the three companies aa 
X, Y, and Z. The teat wns given to the usual routine office clerks 
of compniiy X and Y, the only difference being that women clerks 
wore the subjects in company X, while men clerks in company Y. 
In the case of company Z office boys only were examined. In each 
cfvSG L!\ore has bccMi found to exist ii do finite relationship between 
the mental alertness oC employees, as deter mined by lest scores, 
and labor turnover. However, thi.s relationship is not always the 
same for the three cunipnnies. 

For company X, it has been found that about 40 per cent of 
the women clerk.s hired who have nn alertness score between IB 
and 30 leave within six months; this percentage decreasing rapidly 
witli the increase in the lost scores, until the least labor turnover 
is found among clerics who scored between 35 and 50. For those 
whose SCO re a were above 50, the percentage leaving increases rather 
rapidly until we reach tho.se scoring highest, where the instability is 
the greatest, greater than for the clerks scoring low in the mental 
alertness.’ From the above relation.ship of mental alertness and 
turnover wc may infer that company X does not give due weight 
to the imcessity of rapid promotion for its most alert clerks. 

For coiiipaiiy Y, as in the above case of company X, the labor 
turnover ifV high for employce.s znaking low scores; instability rises 
with an upward trend of the alertness scores until the highe.st 
scores are 2'cached, where there is found a pronounced increase 
in instabilityp n condition unlike that of company X, That differ¬ 
ence between the two companies iipponred, at the time, to be due 
to a ])eculiar wage situation causing in.stnbility among the middle- 
high employees." That points again to our original contention re¬ 
garding the cause of bigli labor turnover, that complete generaliza¬ 
tion is impossible when the phenomenon is studied in the light of 
only one i.sol a Led factor. "VVliiiL cjin be said, however, is that it is not 
true that the ^'iiiakc shift'* or the ‘‘general run” of employees 
is responsible for the high labor turnover, but among other 
factors the incompatibility of the requirements of the job with the 
capacity for iizeiilal alertness as manifested by the worker, is an 
important contributing cause—and perhaps, at times, the only 
cause for labor turnover. That becomes of further significance 
with the in 11 It)plication of oiir experiments, such as the following 
one, made in company Z. 

In company 2 in Pobniary, 1920, one hundred and eleven boya 
under eighteen yeiirs of age were given the men Lai alertness tests. 
Thn results were filed away and no use was made of them until No- 

-ScoU L'i»iui>aiiy riibui'nlory IhillcLln L- No. *2. :ni20. 
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vembei', 1921, when the scores wore brought out of the filcfi and com¬ 
pared with the progress made by the boys during the intervening 
twenty-one months. It has been found that tlic average score 
for the one hundred and eleven boys was oft.7, while the score 
for the sixty-three boys, still in the eomiiuny^s employ, was 41.C, 
and the average score of those no longer wiLli the company was 
35.1. That the hoys mn'king a high score are inobl likely to re¬ 
main with the company becomes evident from the above figures; 
while the hoys leaving the company's employ did so for throe 
reasons', first, for betLcr positions—Ihcir uvevage score was 44.i 
(notice that the score is higher than that of the l)oy.s remaining in 
the employ of the company) ; second, to return to school; third, 
lischarged by the company—their average score was 

If we should compare the sabiry of the boys on November 1921. 
with the alertness scores we find the following relntionsliip: 
Number of boys. Average alertness score. Average Salary. 

10 67.3 $10.00 

10 23.1 $13.40 

It has also been found that the average score. Cor the twenty- 
iiine boys who were promoted to junior clerkship was 40.2, while 
the score 35.1 represeiiLs tlic average score of the tliirty-four boy a 
who have I’ecoivod no such promotion. 

It is not only intcre.sLing but it is of importance industrially 
to notice that the boys who scored rol a lively high in the test 
either continued in Ibo employ of company Z or left for better 
positions. Almost ah promotion anil, therefore, higher rate of 
pay were won by the boys taken from the same class, even though 
the alertness scores wcx*e unknown to anyone save the indu.sLrial 
relations department. 

It seemsi to iis that, while the results from tho above experiment 
are too scanty to permit any positive generalizations, iiovortheless 
they are sugge.sLive of what might bo done. Consequently, we may 
venture to make the following suggestions: first, that further 
study in this held might determine the relative alertness scores 
which are most suitable for some of the industrial occupations— 
Avhere alertness has been found to be one impovLaiiL factor; second, 
that knowledge so gained will be of practical importance to the 
employment manager; third, that with this knowledge in the hands 
of the employment manager, he will be able not only to reduce 
labor turnover^ where previously the iiialability was mainly clue to 
the incompatability of mental alertness with the rcsponsiblity of 
the occupatioiij but, also, he will be able to detect individuals of 
high alertness capacity whose services to the industry will be in 
their ability to learn rapidly and in thuL way gain quick promotion, 
ending finally with a job, the demands of which will be prop or- 
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tioniil to tliQ wovkcr'M ability. Tbo third sugEcation expresses an 
ideal aitufition which we may put in the sky, ns Plato did with 
his idciil state, 
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HEALTH FELLOWSHIPS AND SCHOLARSITIPS 


The Ainericflii Child IloaUli Association, believinij that health 
is a matter of sound edncatioiij and that no (greater creed can 
he spread tJirouB:h the world tlian the Ijospcd oX good health, has 
instituted an unique series oX health scholarships. 

The sum of §10,000 has been iillolted to these scholnr.sbips and 
fello%Yships, which are to be given to teachers in service ^Yho have 
been especially successful in teaching bciiltb. The nioney will 
be distributed in five §1,000 scholarships and fellowships, to 
college graduates now in service as principals or elementary 
school supervisors; five §500 scholarships to normal school gradu¬ 
ates or college gradimles now engaged in classroom teacliing; and 
fifteen §200 scholarships to holders of teacher's certificates now 
engaged in classroom teaching. 

Those sums are not hard and fast ones, the Committee announces, 
but approximate, depending upon circumstances. It also announces 
that although the conditions require the teiichcu’ to be in service 
at present, an exception to Ihis rule may be made in favor of any 
teacher who has already done exceptional work in health educa¬ 
tion, even if she is not engaged in leaching at present. 

The purpose of these scholarships and fcllowship.s is to improve 
professional training, to enable teachers to do more efTcctive work 
in health education. 

Fellowship and scholarships shall be awarded to teachers in 
ser'Oicc and to teachers not now in active Service but wlio ImVe had 
exceptionally successful experience in health education, who pre¬ 
sent evidence of some of the following niuilificntions: 

a. Success in teaching. 

b. Pleasing and favorable personality. 

c. Good personal health, 

d. Demonstration of unusual interest in health education. 

e. Possession of initiative, originality, letidevship and ovgania- 
ing ability. 

f. In addition to the above, a good scientific background is 
considered of special value, in particular, instruction in biology, 
bacteriology, chemistry, nutrition, personal hygene, public health, 
child hygiene, school hygiene, child psychology ami principles of 
teaching. 

The qualifications of the Institutions in which fellowships and 
scholarships are to be placed should include the following: 

1. Recognition of standards for the promotion of the personal 
health of their own students. 
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2. A liotilLhful onviroiimGTit in the institution for the setting* up 
of dcsir^iWe stnuflnrds from the standpoint of sanitqtion, etc. 

3. A .supplementary course of coordinated subjects of instruc¬ 
tion such as bifliot'-y, nutrition, etc., in addition to the more specific 
training in health education. 

4. Opportunities for observation, prcijaration of programs, prac¬ 
tical teaching in health education. 

5. The providing of training for teachers in othev fields than- 
the field of health education. 

0. A spirit of co-op era lion among the various departments 
co/inecfcc<I with health education, as evidenced by their success in- 
co-ordinating the various eJeinents contributing to health education. 

FelJow.S'hips and scholarships providing for a year’s study shall 
go into cflect with the beginning of the scliool year or in the fall 
of 1023, 

Summer School, Chautauqua and Travelling Scholarships will 
go into crrecl during the summer of 1923. 

The fundamental subject matter in any student’s course should' 
be derived from the following fields: Personal Hygine, Nutrition,. 
Community Hygiene, Social Hygiene, Mental Hygiene, Health and 
care of infants and young children and adoleseense, First aid and' 
safety, Hygiene of the worker, Home nursing’ and eare of the sick, 
School Hygiene, Psysicnl Education, Principles of Health Educa¬ 
tion and Practice Teaching. Practice Teaching to include practice 
in all types of contact with children incident to health work in 
the school. 

For information address American Child Health Association, 
370 7th Avenue, New York City. 

BETTER EYE SIGHT AS A NATIONAL ASSET 

The Eye Sight Conservation Council of America represents a 
distinct and organized phase of the general tendency towards 
social, economic and physical betterment. It aims to bring about, 
improved vision among the masses of the nation, experience in 
education and industry having shown that a long train of ills, 
involving grave consequences, follow in the wake of defective eye 
sight. 

One of the conspicuous services performed by the Council was. 
its participation in the nationwide assay of waste conducted by 
Herbert Hoover os chairman of the Committee on Elimination of 
Waste in Industry of the Federated American Engineering So¬ 
cieties. This committee, whose field activities were directed by 
Mr, Wallace, found that heavy annual economic and physical losses 
were occurring in Amorienn industry through poor vision of the 
workers. All this, for the most part, was characterized as avoid¬ 
able waste, which the Eye Sight Conservation Council has under- 
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taken to wipe out by a thorough mid sysloiiuitie plan of oducation, 

Of the 24,000,000 school children in the United Slates, approxi- 
inalely 10,000,000 can justly claim that their country in not giving 
them a square deal, according to Prof. Wood of Columbia, "For,” 
he says, "they arc liiboriug under n grave handienp—eye defecta— 
which could be mitigated to a great extent,,if not corrected en¬ 
tirely, by the intelligent supervision of the stale and of the teachers 
of the nation, through proper oye tests of all puiiil-s.” IlcLnrda- 
tion is another evil caused in park, at least, by iiiiperfect .sight, 

Experiments to determine the true economic value of jicrfect 
vision will be made. It is proposed to meimiirc the improvement 
in health, increase in quality and quantity of production, advance¬ 
ment of individual performance, mid decrease in losses due to 
waste and accident, Factory, home and school ligliling, now a 
subject of scientific research here and abroad, will be sLiidicd. 

The Council, through its Field Secretary, Charles F, Southard, 
is prosecuting its work in the schools of many cities, This work 
embraces leelurcs to parents, teachers and pupils with motion 
picture illustrations, 

Co-opevation with educiitiomil authorities is the prime purpose 
of the Council. An illmstmtion of this co-opcration is found in 
New 'York City, where the Council participated In the observance 
of Health Day in the schools, when the eyes of more than 1,000,000 
pupils were tested. 

Wherever the Council works, it strives to establish the jirinci- 
ples of ccinliiuied superviision of the children, mothcra co-operating 
with the teachers in identifying defects, often hidden, and in 
applying corrective measures. 
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J, W. W, Wau^in. Cnumitive Facloyit in JlJaiUd In/erioritif aiid 
the Prevention of Dcgencrac]], Miami University, 1922, 48 pp. 

Th <5 writer gives ii brief account of the factors causing mental 
inferiority. The article is u summary ol his study of the personal 
jind family histories of H72 clinic cases. The individuals studied 
are public .school casoa and not in.sLiUitional or ho.spital cases, conse¬ 
quently the wnelusioria cainuit be a/lectcd by hcieditary cases as ia so 
truly applied to inMlitutioiml cases. After a thorough discussion 
of personal and family luaLory daU and with many carefully 
worked out Itiblos, the aullior has drawn the conclusions that in¬ 
ebriety occurs more frcfpicnily thnn any otbor faclor. He also 
makes a statement LbnL the same thing applies to immorality. He 
sum marine a other cases of mciitui deficiency^ such as head injury, 
cercbro-spinnl meningitis, infantile paralysis, epilepsy, etc,, but 
finds few cases na a vosult of Lheni. 

Di’> Wallin gives n valiinhlo summary of opinions amojig experts 
ns to the (Icgroo of hoi'odity amone: foGble-mindedness, Ilia study 
shows that they arc quite divGrgjent in their beliefs. It seems 
that tliG 'Taeta are not yet nil in,'^ and that the causation of 
feeblc-mindednoss is as complex as its conditions. It seems that 
from study (that) wo cannot depend solely upon colonization, 
sterilization and marriage laws foz’ the reduction of feeble-minded- 
ncss, but we must also prevent toxication of the parents as that 
is a big factor in injuring the young child. 

Ohio University M, La Vinu WARNEf?, 

J. W. W, WAUiiN. Investigation of the Sex Eelationship, 
Marriage, Delivgnvjicy and To'uancy of Children Assigned to 
Special Public School Classes. Miami University, 1922, pp. 34. 

This article i.s a summary of a final report to the Board of 
Education of the St. Louis Public Schools. After seven years of 
Gxannining children for Special Education, Di\ Wallin concludes, 
that the Board of Education would have to make provisions for 
more montnliy defective boys than for mentally defective girls. 
He does not give any reasons for this. He found among the 
Special Class enrollment nii average of 2.14 per cent per family and 
a per cent of 3.3 of all the children enrolled in Special Education 
to have a record of delinquency. Ho makes a valuable discovery 
relating to the criminality and vlcousness of the feeble-inindedi His 
discoveries are coiitrai’y to previous beliefs in this matter. Dr, 

. Wallin suggests that the Special Class training given these children 
has corrected this anti-sacial conduct. The same thing is true 
of truancy. Dr, Wallin found only 4.6 per cent of the total 
enrollment of Lhe children in Special Education to be rated 

as truants. The entire article is well-rounded argument in favor 
of Special Education, 

Dv. Wallin gives a further study of the industrial records of 
children in Public School SpeciBl Classes for rnental defectives 
and finds that the records both industrial and criminal so far as 
they go are quite satisfactory and point to the value of Special 
Education, However, a study of the occupations entered show 
that the Special Schools have given very little specific training in 
preparation for them and the employment records of these children 
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iAii’T\ish little evidence as to the type of vocational training which 
should be supplied in the Special Schools. 

The remainder of the article is taken up in a discussion of the 
Legislative Act in the interest of Special Education for the State 
-of Missouri, 

Ohio University M. La ViNNA Warner. 

Strong and Uhrbrock. Job Amlv^h and The Curricxditni. 
Personnel Research Series. Williams and Wilkln.s Company. BaltL 
more, 1923. Pp. 146. Price $1.00 paper, $2.00 cloth. 

Tliere is no doubt that what wc need chiefly in our attempt to 
apply psychology to industrial management, is a large mass of 
ordered material collected ns a result of an actual study from field 
experiment in problems of industrial management. Be it problems 
of employment, fatigue or that of inceiiLive, the important thing 
is not so'much the ideal conditions as the creation of the possibil¬ 
ity for experiment and in that way learn, in the long run, what 
can be done in order to reach some workable schcnio of human re¬ 
lations in this or that particular industry. Such studies have 
been published by Link, Chapman, Myers Scott Company, Carnegie 
institute of Technology and others—to our delight a new .study of 
an important industrial problem by Strong and Uhrbrock has 
just appeared. 

Messrs. Strong and Uhrbrock set before themselves the task of 
the actual field study of the functions of the executives 
in the conmercial printing industry. ^ This survey "was 
iTiRcle for the express purpose of inventorying ^ the du¬ 
ties of executives and discovering whcre_ the emphasis should 
be placed in training men for similar positions" (p, 71.) "Not 
only was it worth while to secure more comprehensive information 
upon which to decide difTerences of opinion between the printing 
department faculty Carnegie Institute of Technology and printing 
exeutives, but also in order to decide difTerences of opinion be¬ 
tween the faculty in the printing department and other departments 
in the Carnegie institute" (p, 71.) To supply material from which 
a well balanced and proper curriculm could be developed and or¬ 
ganized the authors set before themselves the task of making a 
comprehensive study of the various executive jobs within the 
printing industry—the first task was to make a job analysis and 
from that to develop the job specification. These would naLiirnlly 
supply the information necessary for the empirical curriculm 
making. 

Tfie present study, however, is more than an attempt to record 
the results of the above stated survey; as a matter of fact it is 
also an attempt to define the meaning of such an experimental 
attempt'and to state the technique of obtaining the necessary data 
and result. Consequently we find in the book chapters dealing with 
such subjects as the following: job analysis, job specification, the 
construction of a curriculm baaed on job analysis, and a bibliog¬ 
raphy of job analysis material. 

Some "industrial psychologists^’ are coining to the conclusion that 
a job analysis, made for the purpose of deriving a job specifica¬ 
tion—to be used by the employment and training department and 
by the wage committee—should contain a study of the actual func¬ 
tions of a job rather than of a time and motion analysis of the 
worker. This latter type of job analysis has its value, but in a 
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lifFcreiit renlm, which is my iinporlant—in a study of efficient 
vorking metliocls. A job analysis is perhaps not the best name 
because of its traditional connotation to clesig-nate a study of tlie 
iifTerent functions performed by nny firiven worlccn Such study 
nay perhaps be best designated by the name "occupational de- 
icviplion/' This name seems to us lo be more descriptive of the 
nature and content of such n study. The authors define a job 
analysis to be "a method of scientiricnlly dissecting a job in order 
to determine the component clcmonUs and fchoir influence upon the 
length of learning period of the worker, production and labor 
turnover" (p. 22.) This defimtinn we fear is too broad; ifc covers 
more than the type of study made by Lho authors; it includes, it 
seems to us, even the most minute analysis of the worker's time 
and Jnotion, zind of the method of liaiidling himself, tools and raw 
material, 

A job specification, the authors say, is the records of results 
obtained from the job analysis (p. 23.) "The job analysis is the 
means; the spccificfttion is the end" (p. 24.) "Today the most sat> 
jsfncfcory job specification is one that Hats the specific duties in out¬ 
line form nnd contains a complete analysis of duties, man re¬ 
quirements, working conditions, essential education and promo¬ 
tional possibilities" (p. 27.) While in the actual study itself—and 
to our admiration—the authors kept clearly in mind the different 
aims of a job analysis and those of a job specification in their 
theoretical statements, as above quoted, we must confess the dif¬ 
ference is not clearly stated, if not really confused; for example, 
the statement that a "satisfactory job * specification is one that 
Hats the specific duties in outline form and contains a complete 
analysis of duties, "Is that not a part of job analysis or are the 
nature and content of a job analysis and of a job specification 
the same? Or is the difierence only that of function? 

The content of the book is a valuable contribution to the much 
needed experimental work in personnel problems. ^ Not only the 
authors and the psychologists in the Carnegie Institute of Tech¬ 
nology but also the editors of the Personnel Research Series should 
he commended for the type of work that they all made possible 
to appear. It is only to be regretted that more of such studies 
have not appeared up-to-date but we look with confidence to the 
future. 

Northwestern University A. J, Snow. 

Edwin A. Shaw and Edward A. Lincoln. A Coi 7 ipariso}i of 
ihe Intelligence and Training of School Children in a Massachu¬ 
setts Town. Harvard Monographs in Education, Number 1. Cam¬ 
bridge, Mass. The Graduate School of Education, Harvard Uni¬ 
versity. 1922. 

We have in this monograph a report of^ two surveys of the 
schools of a small town. Group tests of intelligence and edu¬ 
cational tests in arithmetic, writing and reading were given in 1921 
and again one year later, The study emphasizes the importance 
of the interpretation of survey results by the teachers and officers 
themselves. It is upon them then that the duty of providing 
remedial measures rests. The reports which are not effective in 
practice in the systems where the data are gathered fail of their 
main purpose. The authors also caution against over-emphasia oi 
.the formal processes which standard tests now measure; and the 
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opinion is expressed thfit most standfirds arc too high for practical 
purposes thus causing a sficrifice of the less easily measurable to 
the more easily measurable results. 

Walter F. Dearborn, Edward A. Lincoln and Edwin A. Shaw. 
Standard Ediicaiioiml Tests hi the Elementary Training Schools 
o( Missouri, Harvard Monographs in Education, Number 3. Cam¬ 
bridge, Mass. The Graduate School of Education, Harvard Uni¬ 
versity, 1922. , , . , 

This monograph gives the detailed results, with sonic comment 
thereon, of the educational tests which were given in Llie investi¬ 
gation of teacher-training in Mis.soiiri. A general suinniavy of the 
results has already been published in "'The Professional Prepar¬ 
ation of Teachers for American Schools'* issued by the Carnegie 
Foiiiiclation, It seems strange that in this university monograph 
the name "Gape Girardeau" should be almost consistently mis¬ 
spelled. 

Ohio University II* 0. Good. 

A, B, Eitt. The Hnvian Instincts in Business. Tlie Lothian 
Book Publishing Company, Melbourne and Sydney, 1922. Pp. VIII 
and 100. 

The author of this book does not claim to liave made any new 
contribution to oiir knowledge of imskiiicts; he has attempted only 
to point out in Avliat way our knowledge of human nature—in the 
major part our knowledge of instincts—can be of value in solving 
the problem of industrial relations, and that seems to be mainly a 
problem of incentives. The "book is an oiitline of some of the 
nmin features of a series of lectures delivered in 1918 to a body 
of men and women represent a tivc of the Melbourne business 
world** (p, VIII). 

Professor Fitt in his attempt to throw some light upon the dilTl- 
cuU industrial problem shows a pretty thoroughgoing influence of 
Professor McDongnl—while hia application of Profcs.sor Me- 
Dougal*s general theory of instinct is clear it lacks the brilliancy 
of Professor Watts' Iveatincnt in his Introduction to the Psycho¬ 
logical Problems of Industry. One is familiar with such an at¬ 
tempt i. e., as started in the United States by Professor Parker 
and followed with last mastery by Mr, Tend; in England by Pro¬ 
fessor Watts. Neither Mr. Tead’s nor Professor Fitt*s books are 
of great value as proposed sokitioiis of the problem of economic 
motives—their worth lies in n different direction. Mr. Tead*s 
vivid examples of industrial maladjustment are useful ns a source 
of cases; while Professor Fitt's application of instincts to the gen¬ 
eral problem of economic motives is suggestive. Both, however, 
suffer because of a lack of method of approach to the problem. It 
seems to us that the only method is an empirical one and no other. 
The tendency today is to base too many deductions and generaliza¬ 
tions of wide economic application on our hypothetical knowledge 
of instincts. It is a pity that we should spend so much of onr 
energy in rationnlization. If we had knowledge of social behavior 
which was derived from experimentation or observation of a very 
large number of social phenomena then with caution we might 
apply such knowledge to our general problem of economic motives, 
but as the case is our present social psychology is the most hypo¬ 
thetical branch of the science and thex'eforo such n procedure is at 
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best only murrc stive and at times—if taken seriously—dangerous. 
Wlmt we might do, however, is to collect a largo number of cases 
and from these, if possible, infer certain hypothesis, and further 
by their application—social and economic experiments—come 
closer to n true Icnowledge of these complex human motives. If not, 
the result of such a .set of lectures as these by Professor Fitt will 
produce comments .such as the one stated in the introduction Isy the 
sponsor of the seric’s; ‘^vhile the hearer could not say that he had 
gained anything that he couhl directly apply in his business, he 
found that his point of view had been changed'* (p. VII), 

Just an Mr, Teiurn fmtincLa in Industry so Professor FitVs book 
Tkc Iluniiin Instincts in HuHiness suggests—even though uncon¬ 
sciously, I presume, because such a point of view is impossible— 
that instincts as motives operate one at a time or if in groups as 
independent units and naturally we find the customary list of 
chapters, of which the following are some examples: *‘The Gre¬ 
garious Instinct," "Suggestion and Imitation/’ "Self-display, Pug¬ 
nacity, Cantra-Kiiggesfcion, Emulation," "The Collecting, Acquiring* 
or Hoarding Instinct,” "The Instinct of Self-abasement in Belation 
to SGlf-assertion." The following will serve as a specific illustra¬ 
tion of the aiithor’.s application of the supposed knowledge of in¬ 
stincts lo « particular problem of. imlustidal management: "Pay¬ 
ment by pieoo rale is Lho method employotl in very many factories 
(in some countries iiulnstrial legislation will not allow it), and- 
there can be no doubt that it gives the most direct approacli to the 
original nnlnre of the instincL For each separate stroke or eJfort^ 
for each unit of work completed, there is a separate unit in pay¬ 
ment. The reward stands in direct proportion to the work done. 
The VOrion3 other methods of task-payment increase the pay with 
increases in the amount of work done* but the increase is not di¬ 
rectly i)vopor Lion III. Still the appeal is greater than that of the 
fixed wage, which doe a not present the continual draw or stimulus 
to efTort." 

"Again, once the rhythmic activity from effort lo reward, re¬ 
ward Lo further eifort is set up, it can be kept going to almost any 
extent, just as the squirrel or hamster adds to its store long after 
the winter’s needs have been satisfied* Thus, subject to the limits 
of human capacity, the appeal to effort of the task-payment sys¬ 
tems never ceases" (pp. 64-05). Here the author forgets the great 
danger a of a "piece rate system" upon the general health and effi¬ 
ciency of the worker; the nervous strain upon the slower employee 
and, what is more, the actual experimental proof that the use of 
wages fis an incentive is rather limited. 

It is interesting to note, however, that the British psychologists 
more than the American—in the United States, however, a group 
of brilliant younger economists—^liave attempted to throw some 
light upon the much vexed problem of economic incentive—a prob¬ 
lem so disturbing to all students of industrial personnel. 

Northwestern University. A. J. Snow. 

U 7 iivcrsily of lowci Studies hi Psychology^ No* VIII, Edited by 
Carl E* Seashore. PsycholDgical Review Co., Princeton, N, J., 
1922. P,x IV, 382. Price (?) 

This collection of monograplis represents a somewhat extended 
series of studies in .sound localization, the psychology of music, 
and muscular reaction. It will be impo.ssible Lo review all the 17 
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nr tides iti any tVioroiij^tipjoinp: way IvecnnsD o[ Llieiv vavinbiiity of 
subject mnttcr, and variety of tcchiiitjiie, since nine of the articles 
are doctors' theses. 

The first three nr Licks by Seashore, IIalv(|r.soii, and Stewart, 
rcsiiectively, deal with the wavo-hhase localization of nouiul.s* Sen- 
shore sketches the proKross made in the subject previous to the 
World War; ilulvcrsun presents a muss of ohiserved data on the 
subject, but sols forth no conchisioiis; wliibi Slewai't, ajjproacliin^? 
the problem from Llie standpoint of physics, reaches the conclusion 
that the phase dYect is not wholly dim to vuryinw intensity-ratios 
but that tlio organs of hearing respond to I be phase a.s such. 

The next eight arLide.s deal with the p.sycliulogy of music, These 
are more or kss condensed doctors’ Ihesesi. Hunch investignlcd 
the acuity of hearing Llirougliout the tonal ran go. lie reviews the 
IH’evioiis work done in this held, describes the tow a IMlch Range 
Audiometec which be pcvfcctccl, and presents data to show wherein 
his instrument permits a much more cifecLive means of detecting 
various types of defects of the internal ear than any inslrmnents 
in previous use, Zuehl's thesis describes n still further develop¬ 
ment of the instrument described by Biinclu lie also esLablinhes 
norms of auditory nenity based upon ages of 0 to 15, 17 to 41, and 
42 to 73 years, in which some very i uteres Ling facts with regard 
’to pitch acuity for high tones is shown. Zuelil iireseiils a very 
brief article describing a stroboscopic device for measuring revo¬ 
lution rates, As a piece of laboratory ecpiipincnt this apparatus 
meets a diflicult situation at reasonable cost. Knock has invosti- 
g ale cl a means of training Um voice by the aid of the eye, Ilis 
measurcmonfcs arc made with the loiiosco])e, the fttandanl 250 fork, 
and the Xoenig resonator. His subjects sang stiiudard tones its 
major third, its llCth, and the octave. His results agree with pre¬ 
vious work in thuL the major third, Llic liftli, and the octavo are 
found to be of about criiial dilFicnUy in singing. Errors in singing 
tGn<I to a daily similarity. It if? found that one can Judge the pitch 
find inaccuracies of another voice better than of liis own. Gaw 
applies the principle of vocational guidance to schools of mu.sic. 
Her data collected from students in music at NorthwesLciHi Univer¬ 
sity shows clearly by graphic representation of individual cliar- 
acterlatics that musical auvveya, thoroughly made, are of great 
value in advising students who desire a iniisicnl education. Stan¬ 
ton's study of inheritance of specific musical capacities presents 
family histories, and a series of musical talent pedigree charts 
which lead her to the conclusion that musical talent is probiibly 
inherited according to Mendelian laws. Merry's article describes 
a method of gi’aphicully recording all the speech inflections of the 
human voice. A detailed description of the apparatus, including 
an illustration, is given alongside sample charts and graphs. 
Schoen's article is a study of the unconscious modifications of Llie 
singer’s voice while attempting to sing a musical melody. Especial 
attention is given the vibrato. He concludes tbab tone.s arc usually 
attacked at a pitch lower than intended when preceded by a lower 
bone, and that they are released at a pitch higher than intended; 
that tones are rarely sustained their full interval; that two tones 
are seldom sung alike even by the same individual that certain 
vowels arc inherently higher than olher.s; and that the emotion 
expressed by the vibrato is made possible because wc have so fre¬ 
quently associated tremor with cinoLion in past experience. Wick- 
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ham's [ii’ticlc is only n preliminary study in the control of intensity 
of Houinls by touch. AfCnc\\r presents two articles in which she 
attempts to compnro the auditory imag-ery of musicians, psychol- 
ogists> and ehiklrftii. She uses the questionnaire method and finds 
that musicians generally attribute themselves with an auditory 
hiiagery which develops with training; Psychologists are more crit¬ 
ical and believe that iheir musical images are more Idnaesthetic 
limn nuditiu'y; and children niicl untrained adults allege a very 
decided aiuliLory imagery of sounds. Her study of great composers 
shows that they invariably posseissed a vivid auditory imagery, but 
this was usually supported by strong imagery in other fields. 

The last three articles are studies in motor capacities. The first, 
by Mi.ss Koerth, (lescribc.s a pursuit apparatus designed to study 
eye hand coordinations. A phonograph disc, with stylus, magnets, 
counter, etc,, compose the appnvntua. Ream’s article auinmari^zes 
previous work with a tapping test, and describes a new technique 
for tin’.s much used experiment. Hensen’s article is a study of 
serial action, llis apparalua consists of a commutator attached to 
a typewriter in such a way that any one of four circuits may be 
closed* His subjects were students, army recruits, musicians, and 
atenographers- He finds a decided personal equation in speed, no 
consi.stcnt relationship between speed and accuracy, some correla¬ 
tion with other motor tests, and slight positive correlation with 
other inotoi* tests, and slight positive correlation with intelligence 
tests and ability to read music at sight. 

Ohio University. C, II. Growdon. 
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EXPERIMENTS ON ROD-DIVINING 


By William S. Fosteh 
University of Minnesota 


Some months ago the pastor of a church in a neighboring town, 
R man about 70 years of age, called at the Psychological Labora¬ 
tory of the University of Minnesota and asked that experiments 
be conducted to measure, and if possible to explain, his apparent 
powers in locating materials by means of divining-rods. 

He gave an account covering 45 years of successful location, 
not only of water but of oib natural gas, iron, gold and silver 
in Wisconsin, Minnesota, West Virginia and Texas, and he pre¬ 
sented documentary statements by engineers and others who had 
witnessed hia successes, amply sufficient in amount and vespecta- 
hility to Warrant the belief that his powers are typical, and at 
least as great and as convincing to observers as are those of 
diviners in general. His utter sincerity was manifest not only 
by his profession and by his action in seeking scientific test and 
explanation, but also through the fact that he agreed without 
reserve that the time and all other conditions of experimentation 
should be determined by usj and that publication should be allowed, 
whatever the favorable or unfavorable outcome of results. Further 
evidence appears in the account below. 

The experiments were conducted in and about the Psycho¬ 
logical Laboratory during the morning and afternoon of March 
26, 1923. The writer was assisted by Professors R. M. Elliott 
and D, G. Paterson. 

TEST 1, DIVINATION OF LOCALITY 

The diviner reported previous uniform success in locating hidden 
coins and watches, and our first experiment is intended to test this 
ability. “Neutral ground^' was discovered in the main laboratory 
and a large table moved upon it. The table top was then chalked 
in 14 squares, each 20 x 20 inches. The center of each square was 
numbered visibly, beginning with numbers 1 and 2 at the left end 
and continuing with odd niimbera on one side and even numbers on 
the other. The floor directly under the table was marked in squares 



304 


FOSTER 


exactly Lo correspond to tbe top, and the door ninfl space beneath 
^veve shielded from sight hy cardboard screens. 

Tile rod used was n piece of fairly stilT piano wire bent in tho 
shape of a small written It was therefore sin a 11 or and more 

flexible mid smooth than the Y of sapling often chosen. The “e" 
shaped loop in the wire Avas approximately 2 inches long and the 
ends, which were held lieUveen the fingers in a coninion divining 
position, were each about 5Vi inches in length. 

Silver coins, a silver watch uiul 2 gold wntches were placed in 
a small cardboard box. An experimenter first placed this box upon 
the fie or in the conlDv of a aqv^ave chosen by the diviner. When 
the diviner stepped upon the corresponding square of the tabic 
top the rod rotated definitely and strongly, When he stood in 
any other square he perceived not even a tendency to rotation, 

A random series of trials was then made. Their order was 
known only to the cxpcrhncntcv Avho did the placing. Before each 
trial this experimenter left the room. The diviner was then 
brought in by a second experimenter, mounted the table, and 
walked slowly over the squares until the rod rotated. In each 
trial he then con tinned exploring Avibhoiit indication over all the 
non-crilieal squares in order, and finally “double checked^ his 
first location. No hesitation was manifesLed at nny time, and 
often the diviner carried or a conversation as he explored. 

The second experimenter recorded tbe estimates, which always 
fell in the center of some square. Thirty-two trials wore made, 
the box boiug placed twice in the center of each of tl-k« 14 squares, 
and at intervals (without the diviner's knowdedge of such in¬ 
tention) 4 trials were mode in which the box was not placed at 
•all, but removed entirely from the room. 

In all of these four latter trials indications were obtained ex¬ 
actly as usual, squares 13, 3, 1 and 6 being designated. In the 
remaining twenty-eight trials the correct square was indicated 
once oiily^ whereas two correct judgments are likely to be given 
by chance alone. 

Considering the two “sides” cF the table merely (i.e., odd num¬ 
bered versus even numbered sq lares) the side was correctly in¬ 
dicated in 57% of trials and vhe wrong side in 43%, whereas 
60% of correct judgments are most likely by chance alone. But 
if Ave consider the accuracy in judgments of '‘end” (i.c., first 7 
rersws last 7 squares; and first six plus square No. 8 versus 
first six plus square No. 7) the outcome more than equally un¬ 
favorable; 37% right versus 63% wi’ong. 

A consideration of the amount of error maao in location verifies 
the judgment that successful locations were rather fewer than 
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chance would indicate. The average error which would most 
likely occur by chance is approximately 50 inches. The actual 
errors average 54 inches* Another fair <but possibly unreliable) 
method of judging accuracy is by a *'pseudo-corre]ation” between 
the square-numbers reported and the numbers given. By rank differ¬ 
ences the ‘‘correlation" so obtained is -.22. A rank-differences 
correlation which considers merely the seven cross-table oblongs 
of two squares each comes out -.13. 

We must conclude that under such rigidly controlled conditions 
no power of accui-ate location whatever is indicated. The as¬ 
surance and lack of hesitation with which such faulty locations 
were made by the diviner in the apparently total absence of cues 
are truly astonishing, but our observation furnished no basis for 
even a guess at explanation. 

TEST 2. DIVINATION OP AMOUNT OP MATERIALS 

Neither the diviner nor any experimenter was permitted to 
know the actual results of the first test, but a second test was 
begun nt once. In preliminary trials (made with knowledge on 
his iJart concerning the amounts of material placed in the box) 
the diviner showed th:it with no materials, the rod did not move; 
with only the coins, the rod moved weakly and slowly; with the 
addition of one watch it moved perceptibly more strongly and 
faster; with still another watch yet more; and with another 
watch added, very perceptibly more. He maintained his ability 
to discrimm.ate with case between these steps in amount of ma¬ 
terial present, and agreed to report accordingly in an experiment 
either "nothing," "weak," "fair,” strong," or "very strong." 

The diviner stood on a square on the table top, An experi¬ 
menter sat beneath the table and placed in random order in the 
box in the canter of the corresponding square on the floor either 
nothing or an indicated amount of material. Twenty-five trials 
were made; 6 with nothing, and 6 with each of the four positive 
amounts. 

The diviner judged correctly in 24% of cases, 20% being in¬ 
dicated by chance. His average error was 1.4 steps, as compared 
with the l.G steps which chance would indicate, The rank-dif¬ 
ferences correlation between actual and estimated amounts was 
-f-.20, P, E. = ±13, (Pearson coefficient = +.12), os compared 
with the .00 correlation most indicated by chance alone. 

It is impossible to say whether these relatively small differences 
from chance are significant or not. To avoid the fatigue of con¬ 
stant mounting on the table, the diviner did not leave the room 
between trials, and the possibility exists that differences in the 
noises made in changing the amounts, in placing the box again on 
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the floor, in the tone of the experimenter's voice in calling "ready 
etc., may have served ciuifee '*uu intention ally” or "unconsciously'^ 
as cues which slightly favored correct judgniGnts. 

TEST 3. DIVINATION OF DEPTH 

As an indicator of depth, the diviner osed i\ heavy straight 
wire rod about 20 inches Jong, fitted with a handle and weighted 
at the outer end. This rod vibrates vertically a given mimber of 
times until it corresponds to the supposed depth of the material 
in feel below the diviner's ground. The plane of vibration then 
suddenly shifts to horizontal. 

"Neutral ground" was located in the hallway on the second 
floor of the laboratoi'y* In the lower hall directly beneath, a 
long step-ladder reaching from floor to ceiling was set up at an 
angle of approximately 70 degrees. The depths chosen for experi¬ 
ment were the 12 steps of this ladder and a point on the floor at 
ita foot. According to monsurements taken after the completion 
of the experiment the rise per step was approximately 11 inches, 
and the range of the thirteen depths chosen varied between ap¬ 
proximately 1.1 and 11.9 feet. 

The experimenter placed the box of materials used in test 1 at 
various depths in a random order known only to himself. Ho 
was never visible to the diviner, but noises made in climbing up 
and down and in placing the box were faintly audible vicL the 
stairways to any one in the second floor hallway where the diviner 
stood. The possibility of such auditory cues might have been 
avoided by leading the diviner from the hall between trials but 
time did not permit. The diviner and the second experimenter, who 
stood by him and recorded his estimntea, knew nothing of the 
actual depth-positions used save that they varied by steps be¬ 
tween the two floors, 

Twenty-six trials were taken in random order, each of the 13 
depth positions being twice used. In each trial the diviner used 
first the location rod and then the depth-rod described above, He 
then gave verbal reports. Estimates such as "between 7 and 8 
feet" were recorded as 7% feet. 

The estimates ranged between 3 and 16.5 feet. Seventy-seven 
per cent of trials were over-eatimutions, the average eatimate 
being 9.6, as compared with a true average of 6,6 feet. The 
average error of estimate was 4,6 feet (in a range of about 11 
feet) and only 12% of the judgments were accurate within 1 ft. 
The rank-differences correlation between the actual depths and 
the diviner's estimates was +.29, (P. E. = ,11) which even in bo 
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few trials ought perhaps to be regarded as significantly better 
than chance. 

TEST 4. DIVINATION OF DEPTH WITH INTENTIONAL 
SUGGESTION 

About two-thirds of the way up the stairways leading frotn the 
first to the second floor hallway mentioned in test 3 are two land¬ 
ings, from which both the step-ladder and the diviner could be 
seen. In test 4, taken in the afternoon, six spectators were allowed 
to stand and watch both the placing and the divining. In order 
clearly to sec the experimenter place the box on the upper steps 
of the ladder, spectators naturally lean forward slightly. 

The diviner was told simply that further experiments on depth- 
estimates were desired to check those of the morning, and that 
some of our graduate students and instructors who had never seen 
divining would be interested to observe it. The spectators did 
not in gener«al know the purpose of the experiment save that a test 
of divining was being made. They were warned not to talk loudly, 
nor by smiling when estimates were made to give possible in¬ 
dications of necitraey or inaccuracy. After half of the trials were 
made the spectators were told privately to try to make their ob¬ 
servation of the experimenter*s "placings” somewhat less visibly 
evident by avoiding leaning to sec the upper stops of the ladder. 
All watched with some interest a .series of 26 trials, which in all 
other respects exactly duplicated those of test 3. 

The estimates ranged between 2 and 15 feet. Only 58^, 
instead of the 77% of test 3 were over-estimations. The 
average estimate was G.9, as compared with the former average 
of 9.B, and with the true average of 6.5 feet. The average error of 
estimate was reduced from 4.5 to 2.3 feet, and the percentage of 
estimates accurate within 1 foot was raised from 12 to 19. After 
the twenty-sixth trial, 5 successive additional trials, made as if in 
continuation of the series, but with the box of materials entirely 
removed from the hall, resulted in estimates of 2, 14, 3, TVz and 
3 feet. 

The fact that after test 3 the diviner had seen the experi¬ 
menter measure with a yard-stick the total height from floor to 
floor may partial!''’’ account for the improvement in the range of 
his estimates, an . .or some of the decrease in amount of over- 
estimation and of errors, though there is no evidence to show that 
such correction was realized or knowingly made. Such knowledge 
of absolute distance, however, would not by itself tend to raise 
ii ranfc-differciices correlation above that obtained in test 3, since 
relcUivG rnnU-ordcr (and not absolute accuracy) is here the deter- 
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mining factor. The correlation, howc'vcr, ^vfls actually raised from 
-h‘29 to +.77, and this notable improvement in accuracy of re¬ 
lative depth accordingly appears to be due to cues obtained from 
the apecfcfltor’a behavior (unconscious and involuntary movements). 

Spectators agree that external observation of the diviner'a be¬ 
havior did not at all indicate that he gave any particular or 
intentional attention to them or their ncliona. When not con¬ 
versing he appeared aimply to he "entrancedly*' attentive to the 
action of the rod. He himself, with every objective indication of 
sincerity, maintains that the rod simply "acts of itself", inde¬ 
pendently of or "almost in apite of" his volition, and he has no 
theory to account for his apparent and real .successes under less 
strictly controlled conditions in the field. 

He was entirely surprised when shown the results of the tests 
described, and maintains that his experience had led him to be¬ 
lieve that his estimatea under our conditions would be nearly or 
quite perfect, Whdn our theory as to cues was propounded after 
experimentation, he still could not believe that sucli a theory can 
be applied completely or adequately to explain hia previous suc¬ 
cesses, and he made no attempt to justify or to explain the re¬ 
sults here presented. 

TEST 6. THE LOCATION OF WATER-MAINS 
In order more nearly to approximate field conditions, the diviner 
was asked to judge, through indications of location, direction, 
width and depth, the probable course of water-mains leading to 
two buildings on the Campus, An experimenter, who know the 
true 'locations, accompanied him and recorded the ohservationa 
on a rough map. Light snow covered the ground in most places. 
The results obtained arc difficult to describe without reproducing 
the map, but our general impression is that, as is usual in such 
cases, the diviner's judgments while by no means perfectly ac¬ 
curate or coinplete, were far too accurate to attribute solely to 
chance. In case of the first building the only probable course 
indicated waa near the true main, which leads 250 feet to n neigh¬ 
boring building, but it was distant about 15 feet at one end and 
about 50 feet at the other from the true course. The indicated 
depth of 11 feet is approximately the true depth, A second indi¬ 
cated course of about 100 feet at 30 feet depth was at an angle 
to a se^Yer'pipe leading from the rear of the building and opening 
out of sight about 50 feet down the river-hank. 

In the case of the second building an L-shaped course of 80 
feet at 10 feet depth, ending nt a visible hydrant waa indicated 
exactly over a true main, but a second main lending to the build- 
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inff was pjiascd over entirely without indications. These out-of- 
door observations appear typical and in ell essential respects 
Bimilar to nuniorous observations reported by Barrett^ anti others. 
Such experiments point to a judgment that under field conditions, 
where surface signs and cues from the accompanying person are 
possible, the diviner is usually more accurate than chance would 
indicftle. 

SUMMARY 

A fair sumtnnry of the evidence regarding the accuracy and the 
explanation for the apparent sucesses of diviners is entirely im¬ 
possible in short space.-* In general, however, the evidence appears 
to the writer to justify the following conclusions: 

1. The matter c/innot be dismissed by saying that tlie diviner's 
successes hi the Aeld are simply lucky or chance hits, but they 
probably far exceed the expectation of chiincc, 

2. Divinerfi are not in general cliailatans, but sincere bolieversv 
in their powers. They do not in general possess accurate geo¬ 
logical knowledge, nor do they in general appear to rely greatly 
upon vohinlary observation of contours and other surface signs^ 
such as experience may have taught them might be signiAcant. 
If such signs are important, as tliey appear to he in some cases, 
knowledge of their pre cep Lion and importance, and knowledge of 
his own reliance upon them is not in general realized by the 
diviner, 

3. In almost all field experiment a" the diviner has been ac¬ 
companied by n checker" or person who possessed knowledge of 
the true locations, depths, etc., and cuts given unconsciously by 
such persona in their involuntary movements or unguarded speech 
appear to be a common basis for the diviners indications, even 
tlioicgh again the divinei' may not, and usually does not, 
hite?itio7iuUy observe such signs or realize their importance. 

4. Experiments in which the cues mentioned in 3 and 4 above 
were rigidly excluded arc rare, and their results in general are 
either inconclusive or actually negative. The experiments in 
which predictions made by geologists and by diviners disagreed, 
and where wells Avere Inter drilled to mjcertain the facts, do not 
appear crucial, and the results ax-e variously eiitimated and ex¬ 
plained by di/Terent investigators.^ Tavo previous experiments 
under conditions soineAvJmt similar to our own test 1 are briefly 

l«^ A. llniTi'U, A’f.'dt'rt/'cA. Vo7. li'J, 1B07, Jip- 

fill a Voi. Ki, WHO, i>i). i:ic)-:?s:i. 

‘A fiilrly lull lilbllopniiiliy kIvcmi hi The OiDitiHiu Rod .-t fits fan/ of 
Water-Wilrhhitf, \\ S. Survey Pnmiililul 410, 1017. 

u. \r. W .r, Solliiui Prof. N. /*. }i., *2, 18SI, ui). 7^-78, unil ^y. Ilurrett. 
o/J. Vol- 1.1;. i)j». 111-01. 
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reported or referred to.' The resulig appear quite uniformly 
negative, since the diviners obtained approximately the percentage 
of successes which chance would indicate. DifTetences in humidity 
and temperature, etc. (tog-ether with hyperaosthesin) have been 
proposed as cues without, it appears, great warrant. In view 
of the facts that diviners appear more successful and believe 
more in their ability to locate water than metals, running rather 
than standing, and shallow rather than deep water; that pliimbeva 
commonly listen for leaks and that everyone has noticed the 
peculiar auditory quality of the moving water current, it is 
strange that one finds on casual reading no suggestion that ^solt 1 Id 
may be an important cue in many cases- I am told that in some 
countries putting an ear to the ground is a recognized method of 
locating underground springs or courses, Our ow]i experiments 
certainly point to its possible and probable significance under cer¬ 
tain conditions. The psychologist certainly does not, at any rate 
until furllicr inexplicable facts appear-, need to suppose a special 
sense nor a special mystical power of '^clairvoyance'* or “telepathy" 
to explain wiiter-diviuing. 

5. The movements of the rod appear to the diviner to be auto¬ 
matic, and often not even to be subject to his vohintary control. 
The form of the rod and the mechanics of its movonieiit are sucli 
as to favor the suggestion that it "moves of itself" and sometimes 
moves ill spite of vohinLnry efforts geniiiTiely made to res train it/ 
From II 11 believers who inwardly vow in advance to hold the rod 
steady “though an ocean should ho flowing beneath their feet,” 
reports are not uncommon that they do not succeed, but that the 
rod "twists the more, the more they endeavor to restrain it." 
The various forms given to the rod, the success of some diviners 
who use no rod at all but go by "impressions" or "shiver**, and tlie 
facts that only a relatively small percentage of persons are "sen¬ 
sitive", that the indications appear only if the diviner is "set” 
for them, and other facts too numerous to mention, all indicate 
that the existence of a psychical automatism and the presence 
of some suggestion to touch off a recognized response are the only 
necessary and essential bases for the "indications**." 

This hypothesis is all the more probable in the light of our 

JO, II. ruiiHi': Pm* r . h\, 2 , lasj, pp. TO-OJ, mul w. r. DarrDtt, 
0 J>. r(l,, Vol. 11^, 1 ^. \ 1 \\\ Vi>l. iri, p. W. 

'S I*, for ('xmiiplo, iHiim'rtJiiK ill^(Jlllcos j;lv(»ii ijy W. I''. Il(l^roL^; o/). cit., 

M, ('\U\iiu •, iS’jM’i'iUia/Uni ffUrf thv PHj/choloi;};, lOIiO, pp. 

’‘‘Aoci in piir.yinj^ Iho involniilavy and iiilcoilKtiious mvi.scular eouLractinii 
whicli cixiihcs the niotlf|fi of Li e I'orkL'd Lwl«- or nid, many divinci'i^ cxi>oi'i- 
(‘iK'r i\ ]M'ciilJ(u- vialufi^t' iiinl siuiir n ronvnJHlvn Hjiiism. * * * atnlt* of 
monoldrlsin of Hit* (loiixor orcnlt's n ('ondlUoji uf purl Ini naUili'pfjy M’Jinii 
Hiniit* sum: jTt’Mlloll cuiisi'.H III * klcu li> culiiiliiiiio.'’ IliirrcLL: o/i. cit., Vol. lu, 
Ti :n4. Set* ulsn Vul. i;5, pij. 272-277, Vol. JS, up. i:i0-131, and 

L-ls nluTO. 
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knowledge of the pert played by hyperaeathcsia and "unconscious 
notice" preceding or during trance, and in hypnotic recall, the 
determinntion of dreams, automatic writing and the like, and in 
the light of our knowledge of the importance of cues and sug¬ 
gestions often given by the knower's unconscious and involuntary 
actions and accepted by the "sensitive" without clear realization 
of the fact. To become convinced in the latter regard, one has 
only to compare the conditions and results of divining with those 
of mind-reading, muscle-reading, table-turning and of thinking 
animals like Clever Hans. 



A STUDY OF THE APPROPRIATENESS OF 
TYPE FACES 


By a. T, POFFEMilEIlGEn 
G0I4UMDIA. University 


And R. B- Franken 
New Yonic University 


In the search for perfect advertising no factor is considered of 
too slight importance to deserve careful investigation. The laws 
of human belinvior as discovered by the psychologists have been 
generally called upon in order to draw away from nn individual 
the control of his behavior and pub it into the hands oE the ud- 
vertiser. By far the greatest amount of consideration has been 
given to the mechanical devices for gaining and holding attention, 
nnd for making impressions permanent, The feelings, pleasantly 
and unpleasantly boned, arc coming to be looked upon as forces in¬ 
fluencing reactions to advertiaing sufTiciently to deserve study. 
Freudian psychology, with its well-known doctrine of the supprea- 
aion of the unpleasant, may have something to do with this spread 
of interest. However, IlolUngworth some years ago showed the 
bearing of the ^'oblivisceiice of the disagreeable" upon adver¬ 
tising, and pointed out that advertisements to bo most effective 
should be pleasantly toned. No labor or expense is spared on the 
makeup of nn advertisement and especially in color and art work 
in order to make it pleasing, Much of this elaboi^nte use of ar¬ 
tistic material is sometimes criticized on the ground of lack of 
nppropinafceness, for after all is said, it is the appropriateness 
of the presentation thnb determines whether or not the total effect 
shall be pleasing. 

Typography has long been believed to be a source of mildly 
pleasant or unpleasant feeling tone, according to its character 
and appropriateness, and this belief has influenced the choice of 
type in advertising. The accompanying cut (Fig, 1) will illustreite 
the differences in the type faces used for various kinds of com¬ 
modities. In the case of "DissLon" and "Speed-grits" the type very 
clearly carries something of the atmosphere of the cominodity. 
In the case of the othex’ names the appropriateness may not be 
so evident. The belief is fairly general that heavy faced type 
carry with them the atmosphere or feeling of solidity and strength, 
and that the thin faced type suggest fineness and delicacy. Figure 
2 shows in a striking way the type faces that arc supposed io< 





PIGUEE 2, 




.‘314 


POPPENBERGER-PRANKEN 


cany the atmosphere of cheapness, dignity, femininity, antiquity, 
nature, and elegance. 

The only published experimental study known to the authors 
of the appropriateness of type faces is that of Berliner/ She 
measured, by the order of merit method, the relative suitability 
of eighteen styles of hnndlettcred type for advertising each of 
four different commodities, namely, fish, pork and beans, pan-cake 
flour and orange marmalade. Four groups of people wore used 
in the measurements. The coefllcicnls of correhation among the 
groups for any one commodity will show the degree of agroonienh 
among the groups concerning the appropriateness of the type 
faces for that commodity. The average coefTicicnt of corrclnLion 
for each of the four articles is given below*. 


Pish 

+.71 

Pork and Beans 

+ .74 

Pancake Flour 

+ .G2 

Orange Marmalade 

+.50 


The author interpreted these coefficients ns indicating the degree 
of defmitene?is -of the atmosphere possessed by the eommodilies, 
and as the figures show, this definitenuss varied somewhat with 
the commodity. 

If now the average orders obtnined from any group of subjects 
for the different commodities are correlated, the si^rc of the coeffici¬ 
ents will indicate the degree to which the order of the type varied 
for the differ cut commodities or what the author called the speci¬ 
ficity of the Aliiio.«5phere, The following figures (Table I) were 
obtained from the judgments of a group of one hundred peopie: 




TABLE I 






1 

2 

3 

4 

1. 

Pish 

— 




2. 

Pork and Beans 

+.75 

— 



3. 

Pancake Flour 

+ .15 

-1-.20 

— 


4. 

Orange Mann, 

-.32 

-.15 

+ .31 

— 


Thus, the order for fish and orange marmalade tended to be 
reversed, (-.32), that is, the style of type that was most appropri¬ 
ate for fish tended to be the least appropriate for marmalade. On 
the other hand, for fish and pork and beans the orders resembled 
each other very closely (-|'.76). The author concludes that com¬ 
modities might be grouped into classes according to the character 
•of their atmosphere and that type might then be chosen which 

‘ztsen, t. Angcu-diulte Tfiyehol., HcL 17, 11)20. 
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would be appropriate for any member of the clasa. 

The experiments to be described in this report differ from those 
of Berliner in several respects, namely: 

1. Instead of hand lettering, the material consisted of twenty- 
nine of the type faces coiiinioiily used for advertising work. 

2. Appropriatenesa of type faces for both abstract qualities 
and for iictual commodities was mcEisured. 

3. The judgmenta of men and women were kept separate in 
order to show whctliei' sex differences in this fom of 
reaction were present. 

4. In only a few cases was the same person asked to judge 
more than one commodity, and then only after an interval 
long enough to minimize the effect of the memory of pre¬ 
vious arrangements. 


A modified form of the order of merit method was employed in 
this work on account of the large number of specimens to be 
judged. The type faces each mounted on a separate card were 
first sorted by cnch judge into live piles, the first pile containing 
the most appropriate and the last one containing the least appro¬ 
priate specimens. The order of the specimens waa next determined 
within each of the five groups. Finally, the specimens in the five- 
group a were put together into a single order. From forty to 
fifty judgments were obtained in this manner for each of the ten 
categories given below: 


Cheapness 

Dignity 

Economy 

Luxury 

Strength 


Automobiles ^ 
Building Material 
Coffee 
Jewelry 
Perfume 


On the following pages are given the samples of type faces used 
in the experiments with their technical names and also the final 
rank’ obtained by each specimen when judged for its appropriate¬ 
ness for each of the categories listed above. Position I indicates 
the most appropriate specimen, and 29 the least. As there were- 
twenty-nine specimens, the position of any specimen may vary 
from 1 to 29. The type as illustrated in this report are somewhat 
smaller than those used in the actual experiment, having been 
reduced in order to fit the printed page. 

*Thc nguroH roproaent rniike olitalnoil from men aubjccta only. As ivllL 
be deninnutrn Led Inter, the reaeLlona of the noxcy In thla Ktudy lire bo 
Blmllnr hb to miike prQHcntfitlon of both flois hgnrcB unueceeBary. 
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WHEN. in the course of human 
^events, it becomes necessary $ 1234 &- 



A- 

-Della Robbia 


Cheapness 

17 

Automobiles 

12 

Dignity 

14 

Building' Material 

16 

Economy 

5 

Coffee 

16 

Luxury 

12 

J ewelry 

12 

.Strength 

16 

Perfume 

6 


WHEN, IN THE COUKSE OF HE- 
® man events, it becomes neeessary 
for one people to dissolve ^^1234'5& 



B—Bodoni Bold 


Cheapness 

7 

Automobiles 

6 

Dignity 

17 

Building Material 

9 

Economy 

9 

Colfee 

10 

Luxury 

16 

J ewelry 

20 

Strength 

9 

Perfume 

21 


WHEN, IN THE COURSE OF $12 
^ human events, it becomes 34 



C—John 

Hancock 


■Cheapiiesa 

2 

Automobiles 

8,6 

Dignity 

23 

Building Material 

3.B 

Economy 

14 

Coffee 

2 

Luxury 

26 

Jewelry 

26 

Strength 

3 

Perfume 

28 
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c V/l liCM, 

IM 'Cl 

(!•: oouiLSJC 

Oil' 






D—Royer oft Tinted 


'ChoapnGSS 

25 

Automobiles 

22 

Dignity 

6 

Building Material 

20 

Economy 

27 

Coffee 

18 

Luxury 

7 

Jewelry 

7 

Strength 

19 

Perfume 

8 


WHEN, IN THE COURSE OF 

human events, it becomes neces $12 



E— New 

Caslon Italic 


<JheapTiesa 

IB 

Automobiles 

7 

Dignity 

12 

Building Material 

19 

Economy 

19 

Colfee 

19 

Luxury 

11 

J ewelry 

19 

Strength 

17 

Perfume 

10 


^ WHEN IN THE COURSE OF HUMAN 
^ EVENTS IT BECOMES NEC $1234 


F—Blair 


Cheapness 

21 

Automobiles 

23 

Dignity 

7 

Building Material 

22 

Economy 

11 

Coffee 

22 

Luxury 

10 

Jewelry 

8 

Sttenifith 

21 

Perfume 

11 
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when, in the course of 

human events, it becomes $i 2345 & 



G—Cnalon Old 

Style ISlo, 471 


Clienpness 

13.5 

Automobiles 

15 

Dig-nity 

13 

Buildinff Matcrinl 

15 

Economy 

6 

ColTee 

11 

Luxury 

13 

Jewelry 

13 

Strensth 

18 

Perfume 

14 


WHSNy OF 

H human events, it becomes necessaiy for one 
people to dissolve the political $1234561^ 


H—Caslon Old Style No, 471 Italic 


Cheapness 

24 

Automobiles 

17 

Dig-nity 

8.5 

Building Material 

2j 

Economy 

24 

Coffee 

27 

Luxury 

6 

Jewelry 

3.5 

Strength 

27 

Perfume 

2 

WHEN, 

, IN THE COURSE OF HUMAN 

events, 

it becomes necessary for $123 


I—New York 

Gothic 


Cheapness 

13.6 

Aiitomobilea 

20 

Dignity 

IB 

Building Material 

8 

Economy 

4 

Coffee 

14 

Luxury 

17 

Jewelry 

22. 

Strength 

8 

Perfume 

22. 


WHEN, in the course of human events, it be- 
J comes necessary for one people to dissolve 
the political bands which have con $123456&r 



J—Century 

Old Style 


Cheapness 

11 

Automoliilea 

24 

Dignity 

22 

Building material 

25 

Economy 

2 

Coffee 

1ft 

Luxury 

18 

Jewelry 

21 

Strength 

24 

Perfume 

15 
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K iWl|^n,nt %rnurj3^ of tjuman 



K—Old English 


Cheapneaa 

22 

Automobilea 

26 

Dignity 

4 

Building Material 

23 

Economy 

28 

Coffee 

23 

Luxury 

4 

Jewelry 

11 

StiengHiH 

15 

Perfume 

10 


WHEN, IN THE COURSE OF 

^ human events, it becomes $12345&. 

L—Goudy Old Style 


Cheapncsa 

16 

Automobiles 

16 

Dignity 

11 

Building Material 

17 

Economy 

8 

Coffee 

17 

Luxury 

16 

Jewelry 

10 

Strength 

20 

Perfume 

9 

WHEN, in the 

course of human 


M events, it becomes necessary for 


one 

people to dissolve $12345r>7& 



M—Scotch Roman 


Cheapness 

19 

Automobiles 

13 

Dignity 

19 

Building Material 

13 

Economy 

3 

Coffee 

12 

Luxury 

20 

Jewelry 

16 

Strength 

14 

Perfume 

17 

WHEM. IN' THE COUKSE OF,HUMAN EVENTS, /T, BECOMES 
^ necessary for one people lo dissolve Ihe political bands which'Itave. $’234- 


—Circular 

Gothic No. 44 


Cheapness 

20 

Automobiles 

28 

Dignity 

10 

Building Material 

26 

Economy 

16 

Co/Fee 

2S 

Luxury 

8 

Jewelry 

5 

Strength 

26 

Perfume 

3 
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WHEW, m THE COUHSE 
o of human events, it becomes 
necessary for one $1234& 


0—Antique Bold 


Cheapness 

1 

Automobiles 

3 

Dignity 

27 

Building MnteriAl 

1 

Economy 

18 

Coffee 

3 

Luxury 

26 

Jewelry 

28 

Strength 

2 

Perfume 

25 


WHEN, IN THE COEKSE 
^ oi human events, it $133A: 


P—Mastcvman 


Cheapness 

6 

Dignity 

26 

Economy 

20 

Luxury 

23 

Strength 

4 


Automobiles 2 

Building Material 2 

Coffee 6 

Jewelry 20 

Perfume 2^ 


4M // ^■4RCOfHCA 

Q onm jyco^fo /q c/fA 6 o&a /^c pafyicaf Aiju/a 41)^4^ jfitOa cafi^iuc^e</ 

Ofi-c/ /q addtfntej arr^an^ /^o yjotO^atti 
ear/y^ cz/i-</ is/<iAo/i Aj *Q^icJt ^I23-^/SG7S90& 

Q—^Typo Slope 

Cheapness 28 Automobiles 

Dignity B Buildine Material 

Economy 26 Coffee 

Luxury 3 J ewelry 

Strength 29 Perfume 


20 

29 

29 

2 

1 
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WHEN, IN THE COURSE 
of human events, it $ 123 & 


R—Century Bold 


CKeapnoas 

0 

Automobiles 

1 

Dignity 

29 

Building Maternal 

3.5 

Economy 

21 

Coffee 

7 

Luxury 

27 

Jewelry 

24 

Strength 

5 

Periuine 

28 


WHEN, in the course of human 
s events, it becomes necessary 
for one people to dis- $12345&. 



S—^Po3t Monotone 


Cheapneaa 

12 

Automobiles 

11 

Dignity 

16 

Building Material 

11 

Economy 

7 

Coffee 

9 

Luxury 

21 

Jeweli'y 

18 

Strength 

10 

Perfume 

16 

_ WHEN, 

IN THE COURSE OF 


human events, 

it beco $123456& 



T—Caslon Old Style 


Cheapness 

9 

Automobiles 

5 

Dignity 

18 

Building Material 

12 

Economy 

10 

Coffee 

8 

Luxury 

19 

Jewelry 

17 

Strength 

11 

Perfume 

20 


u WMEINIp IM TIHIE COURSE OF $1 

U—Cheltenham Bold Outline 


Cheapneaa 

26 

Automobiles 

21 

Dignity 

8.5 

Building Material 

21 

Economy 

23 

Coffee 

20 

Luxury 

9 

Jewelry 

6 

Strength 

23 

Perfume 

7 
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V ivrHuvCCouv L' o f u \\\ au 



V—Ti/Tniiy Text 


Cheapness 

29 

Automobiles 

18 

Dignity 

2 

Building Wuterin\ 

28 

Econoimy 

25 


26 

Luxury 

1 

Jewelry 

3.6 

Strength 

28 

Perfume 

6 


^ WHEN, in the course of hu¬ 
man events, it becomes $1234 

W—Bookmnii Old Style 


Chenpness 

li> 

Automobiles 

10 

Dignity 

24 

BuUding Mftfcccial 

10 

Economy 

1 

Coffee 

13 

Luxury 

22 

Jewelry 

21 

Strength 

12 

Perfume 

10 

WHEN, 

IN THE 

COURSE 

OF 


human events, it becomes $1234& 


X—ChoUenliflni Bold 


Cheupmsa 

8 

Automobiles 

4 

Dignity 

21 

B nil cling MnLcrial 

0 

Economy 

12 

Coffee 

6 

Luxury 

24 

Jewelry 

23 

Strength 

7 

Perfume 

26 

y WHEN, 

IN THE 

COURSE OF H 


events. 

it becomes me $1234^ 



Y—Globe Gothic Bold 


Cheapness 

3 

All loin obi I es 

14 

Diginty 

28 

Building Malerinl 

6 

EcQwnwy 

17 

ColYce 

1 

Luxury 

29 

Jewelry 

29 

Strength 

1 

Perfiinie 

29 
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. WUKN, IX' TIiniK fCOTUIRSIM OIF* WIIIU^IAX IpVlEXTa 


Z—Eng^raver's Roman 


Cheapness 

27 

Automobiles 

27 

Digni by 

3 

Building Material 

27 

Economy 

22 

Coffee 

24 

Luxury 

2 

Jewelry 

1 

Strength 

25 

Perfume 

4 


WHEN, IN THE COURE OR HU 
events, it becomes necessary $13 



X‘ 

—Roy croft 


Cheapness 

4 

Automobiles 

8.5 

Dignity 

25 

Building Material 

7 

Economy 

15 

Coffee 

4 

Luxury 

28 

Jewelry 

27 

Strength 

6 

Perfume 

27 


WHE.N, IN THE. COURSE OF HU- 

yj 

man events, it becomes ,$I23456& 


Bulfinch 


Cheapness 

18 

Dignity 

20 

Economy 

13 

Luxury 

14 

Strength 

14 


Automobiles 

19 

Building Material 

14 

Coffee 

IB 

Jewelry 

14 

Perfume 

IB 


ZI 

Whtw, in tbc Couwe of ibuinnn $123 


Z'—Pnory Text 


Cheapness 

23 

Dignity 

1 

Economy 

29 

Luxury 

5 

Strength 

22 


Automobiles 26 

Building Material 24 

Coffee 2B 

Jewelry 9 

Perfume 13 
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An examination of the positions nssigncil to the spccimcna vi?heTi 
judged for the ten types of appropriateness shows that their re¬ 
lative effectiveness varies according to the purpose for which 
they arc to be used. Differcnceg in the degree of variation are 
filso to be noted. For example, specimen Y' varies only from posi¬ 
tion 13 to position 20 in the ten categories, while Z‘ varies nil 
the way from 1 to 29. The former type specimen would serve 
moderately well for any purpose, while the latter is cither veiy 
npropriate or very inappropriate. The same may be said of speci¬ 
men Z. The range and distribution of the positions nssigiied to 
the type specimens may be observed readily from Table 11. The 
positions from 1 to 29 fire arranged in six groups, indicated 
across the top of the table. The figures in the body of the table 
indicate the number of limes that a given specimen fell in a cer¬ 
tain group regardless of the commodity for which it was judged. 
Thus specimen A was twice given a position within the B-£> 
group, and 4 times within the 10-14 group. More dclniled infor¬ 
mation concerning range and distribution may 'be obtained from 
the figures given under each of the type specimens. 

If values be assigned to the groups in Table II, so that the first 
group is given a value of 1, the second group is given n value 
of 2, etc., the total value assigned to each type face may be 
roughly determined. Such total values would indicate which 
type, if any, tended to be consistently appropriate or inappropri¬ 
ate wherever used, These valiiea are given in Table III, No one 
of the specimens stands out ns gcnernlly best or generally poorest. 
Specimen B appeal’s to be the most effective for nil purposes and 
specimen J the least effective. But the diffevencea arc slight. 

TABLE III 


A 

CO 

G 

30 

M 

34 

S 

33 

Y 

30 

B 

29 

H 

38 

N 

41 

T 

32 

Z 

3B 

C 

32 

I 

34 

0 

32 

U 

39 

X" 

36 

D 

38 

J 

42 

P 

34 

V 

3D 

Y' 

3G 

E 

36 

K 

40 

Q 

41 

w 

36 


41 

F 

38 

L 

36 

R 

36 

X 

33 




The relation among the orders for the different categories may 
be expressed in terms of coelTlcienta of correlation, the higher 
the positive correlation the greater the similarity among the 
orders for the different categories. The coefficients obtained by 
the Rank Difference Method nre given in Table IV for the men and 
in Table V for the women. 

In interpreting thesQ figures it should he remembered that the 
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TABLE II 


ItANOK Ol' VOHlTtnm /USSIBNIil) TO HACK SPBCUirSN 


Type 

roaiLion 1-4 

r>-9 

10-14 

15-19 

20-24 

26-29 

A 


a 

4 

4 



B 


4 

1 

2 

2 


C 

4 

1 

1 


1 

3 

D 


4 


2 

2 

2 

E 


1 

3 

6 



F 


2 

3 


5 


G 


1 

8 

1 



H 

2 

2 


1 

2 

3 

I 

1 

2 

2 

2 

3 


J 

1 


1 

3 

4 

1 

K 

2 


1 

2 

8 

2 

L 


2 

2 

5 

1 


M 

1 


4 

4 

1 


N 

1 

2 

1 

1 

1 

4 

0 

4 



1 


4 

P 

S 

2 



3 

2 

Q 

3 

1 




e 

R 

2 

3 



3 

2 

S 


2 

4 

3 

1 


T 


3 

3 

3 

1 


V 


4 



5 

1 

V 

3 

1 


1 


6 

w 

1 


5 

1 

3 


X 

1 

4 

1 


3 

1 

Y 

a 

1 

1 

1 


4 

z 

4 




2 

4 

X' 

2 

3 


1 


4 

Y‘ 



5 

4 

1 


Z' 

1 

2 

a 


3 

3 
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groups of persons judging ■ware not the same for any Uvo categor¬ 
ies and that rarely was the same judge used twice. Thus, the high 
negative correlation^ between the orders for Cheapness and Digni¬ 
ty (—.34) or between Cheapness and Luxury (-.94) repre¬ 
sents a real difference in elFectiveness and not merely a tendency 
on the part of the judges to be logical, in placing a given specimen 
high for one quality and low for some contrasting quality. Tho 
coefficients for Cheapness and Economy (-hAT) and for Dignity 
and Luxury (-f,9C) are high and positive, Strength correlates 
positively with Cheapness (+.82) and with Economy (+.31) 
while it correlates negatively with Luxury (-.96) nnd with Dig¬ 
nity (-.89). Plain heavy type, while indicating strength, also 
suggest cheapness and economy as compared with the more deli¬ 
cate and ornate type forms. 

A coefficient of correlation of +.94 between the orders for 
Jewelry and Perfume indicates that the type faces that are 
most appropriate for the one arc also most appropriate for the 
other. These two commodities correlate with the orders for 
Automobiles and Building Material -.96 and -.92 respectively, 
showing that the type forms most effective for the one group 
are the least effective for the other group. 

The order for Coffee, while quite similar to that for Building 
Material (+.90) and for Automobiles (+.81) is quite different 
from that for Jewelry (-.91) and Perfume (',96). 

Interesting comparisons may be made between the abstract 
group (Dignity, Economy, etc.) and the commodity group (Auto¬ 
mobiles, BwllAfrig MatsTlM, ett.) Gbenpiiess coty elates positively 
and high with Coffee (+.90) and negatively and high with 
Jewelry ('.94,), and Perfume (-.88). Dignity correlates high 
and positive with Jewelry (+.89) nnd with Perfume (+.80). 
The orders for Economy and Automobiles show a correlation of 
+.28, Economy and Building Material +.40, and Economy with 
Coffee +.38. There is a negative relationship between the orders 
for Economy and Jewelry (-.38) and Economy and Perfume 
(-.29). The coefficients in which Economy is concerned are the 
lowest to be found in the table. Luxury correlates high and 
positively with Jewelry (+.93) and Perfume ( + ;88) and neg¬ 
atively with the other commodities. Strength correlates high 
and positively with Automobiles (+.73), Building Material ( + .93) 
and Coffee (+.91), but negatively and high with Jewelry (-1.00) 
and Perfume (-1.00). 


^Thc followliiff Intovijriitritloiis will l3c bnsed on the flEures far men 
glvon 111 Tnhle IV. 



TABLE rV 

Correlations among the orders for men 
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table VI. 


couurn^ArioN 

hktwehn mkk 

.\Nn woMKN run ni 

FPnillCNT 

rATKnimiKs 


Cheapness 

+ .91 

Autonioliilr.s 

+ .81’ 

Dignity 

+.92 

Building Mntcrinl 

+ .97' 

Economy 

+.93 

CofTee 

+.79 

Luxury 

+.93 

ileweli'y 

+ .94 

Strength 

+ .9-1 

PevCwTuic 

+ .05< 


No cUiVorenccs worth notin(»; appciii* liotwcon tlic record h for 
Tnen and women. (Tables IV nnd V). Table VI sliowinix the re¬ 
lationship between the oi*deva for men and women contains ito' 
cocfTicicnt lower than H-.7n. This similarity of the reactions in- 
the two sexes ixivos additional evidence of the consistency of the' 
ju flymen is of appropriateness of material of this sort. 

The re suits of this cxperiinent show (iiiite conclusively that 
dilTcrinrr type faces do vary in appropriateness and that jiulpcs 
are able to this appropriateness or lack or appropriateness. 

FurthermorCj there is close agreement bclwccu sexes and amoirg 
members of the same sex in the ch a racier of their read ion a to 
the differ Gill: type specimens. 

The experiment produces no measure of the strength of these 
"feelings'^ Certainly, the pleasantness or unpleasantness of the 
effects produced by these difFerent type faces must be extremely 
mild, and it might be argued that such difTorenccs as do exist 
are too slight to warrant consideration for practical purposes. 
However, the appropriateness of typo is one factor among the 
many which determine the iipiiropriatauoss of the advertisement 
ns n whole and therefore cannot be safely neglected. 

Some theoretical interest may attach to the question of the- 
cause o£ the difTerenecs found in this experiment. There are two- 
possible explanations. First, the type faces, by their shape, size, 
toxtin’G and the character of their lines may carry a certain at¬ 
mosphere about them; there may bo inherent in them an atmos¬ 
phere of delicacy, dignity or strength. Second, the utmoaphere- 
which they possess may be nncrGly i\ matter of use. For example,, 
we are accustomed to seeing Old English or similar type, such 
as specimens K, V, or 7i used for imposing find dignified documents 
and plain, heavy type such as specimens 0 and Y for simple and: 
ordinary printing purposes. By the process of association the 
type may now carry the qualities tvausCevred from the settings in 
which they have habitually appeared. 

For present practical purpose it would seem to make little 
dilTcrencc which of these interpretations is correct. It ia suf¬ 
ficient to know that type faces such as utg used in current ad.- 
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vei'tiisin;? pracLice do have characteristic atmosphere and that 
these sl^ould be Riven due wciKht. 

One iurthov point iihouUl be noted, namely, that the efTeefcive- 
noss of type faces such as we, have used in this work cannot. 
ncccssavily be predicLerl from the judgment of one individual, 
even tlmiiRh he may he un expert in typography. Only a test 
upon tin ade(piuto sampling of the population to bo influenced 
will deflnitely dt^lermhni what is the best type to ufie. The 
judgment of one individual may lie safer where the inOrcj extreme 
forms of hiindkitUn'inR are under consideration, although even 
here some furtlier check would he advisable. The elTccL upon a 
sampling of prospects iinist here, as in other cases of control of 
hiinian behavior, he the linal inoasuve of what will or will not be- 
effective. 



INTELLIGENCE TESTS VERSUS ENTRANCE 
EXAMINATIONS AS A MEANS OF PREDICTING 
SUCCESS IN COLLEGE 


By Ada lUaT Arutt and Makgaiu:! IIai.d 
BnvN Mawr ColM'XJK 


This investigation begun in 1919 and comidetud in Juno, 1923 
was undertalccn to determine (1) the relative value of tlie record 
in intelligencG tests and the record in oiiLriinco oxaniinalions ns 
a means of predicting success in n college ^vhioll admits only 
through the regular channels of entrance examinations, (2) the 
extent to which the record in intcliigcnco tests cinihl he used to 
exclude students who succeeded in puasing entrance examinations 
but were not capable of doing adequate work in college, (3) the 
relative merits of two intelligence tests and cm trance exam i nation 
grades as a means of selecting the students who will do LIig least 
indcfiuntc work in college. 

The subjects, 305 in all, were students who entered llryn Mawr 
in 1919, 1920 and 1921, The test results for each class were 
treated separately. As a matter of convenience the classes will 
hereafter be termed Group I, Group H, and Group III in the 
order of the date of entrance into college. Students who withdrew 
for any reason other than poor work before the end of Freshman 
year and students who were given only one of the two test series 
in the class to which two sets of tests were given are not included 
in this study. 

Group I was given the Stanford IlcvLsion of tho Dinet Teat 
used in part as a group test. Interpretation of Fnbleq (XVf, 2), 
Memory for Paragraph (XVIH, 4) and the Vocabulary Test (XVL 
1 and XVlIIj 1) were given to the group as a whole. In the first 
two of these tests the procedure followed was the same as that 
outlined by Terman except that the responses of tbo students were 
written in a regulation college “Blue Book". For the Vocabulary 
Test each student was given the list of one hundred words printed 
with sufficient space after each word to allow for the writing of 
a definition. Ample time was allowed to finish each test. The 
Vocabulary Test was given last and the paper handed in as soon 
as completed. All of the other tests were given individually by 
the writer. 

Group II was also given the Stanford Revision of the Binet 

riir AYvlH'r \vtsli(*s Iut {\vv]t In ||t Mian IMp h 

OrliiUy, Si'Ci'i'lnry nml UoKlslrnr cjf Mii‘ I'tir licr c'mi.sfanl I'D-nimr- 

iiliuii itiwl (■inii“l<*s.y In J'lii'iitslilii^ Ihi* italii iih Ln (Mil I'iincr (*\iiiiiiuiil l^n 
m'orUw iiuO null's In I'olhtro, 
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Test with the same procedure aa that described above except 
that the Inffeunity Test (XVIII,6) was also g-iveii as a group test.* 
As soon as the time aJlDWimce of five minutes for each section 
of this test had elapsed the students turned over a page and began 
the new problem on n new sheet. In order to avoid work on a 
problem after the time limit for that problem was up, no student 
was allowed to turn back a single sheet for any purpose. The 
Thurstone Freshninii Test, Series 1920 Number IV was also 
given to this group. Group III was given the Thurstone Fresh¬ 
man Test, Scries 1919. 

The results of the testa of Group I in terms of I. Q. were cor¬ 
related with grades received in entrance examinations and with 
marks at the end of the Freshman, Sophomore and Junior years, 
and at the middle of Senior year. Marks at the end of the 
Freshman and Sophomore years are in terms of the average of 
all percentage grades received by the student during the year, 
Marks in the Junior and Senior years are in terms of honor points,* 
Grades received in entrance examinations were also correlated 
with mni'ks at the end of the Freshman, Sophomore and Junior 
years and at the middle of Senior year. The formula used waa 
the Product Moment with computations from the true average: 


2 A’y 


■\/ s V 


2 y' 


The results are presented in Table 1. 

TABLE I 

No. of 

students P. E. 

98 Entrance grade.s and marks end of Freshman year .539 .048 

83 Entrance grades and marks end of Sophomore year .548 .052 

74 Entrance grades and marks end of Junior year .641 .055 

74 EntraiTCG grades and marks middle of Senior year ,642 .056 

98 I. Q.*s and Entrance grades -245 ,064 

98 I. Q.*s and marks end of Freshman year .298 .062 

83 I. Q.'s and marks end of Sophomore year .097 .073 

74 I. Q:s and marks end of Junior year .102 -078 

73 I. Q.*s and marks middle of Senior year .100 .078 

As 'will be seen from Table I, 1. Q-'s show a positive but low 


‘ThlH Losl lini nnl Ifiuf llsi'lf woll to use iia ii group tost i,i ab much 
UH titno for oncit iriiiL tuo tri'i'At for 

bLuiIcuU IcsUul, but iili liiul to wiUl unhl tlic ontl of the time Allowed. 

“A ccrluhi fMJmbrr of houor paIjiIs Js jillowcd for ciich hour of work of 
nigh C rod It, CruilU iniU Morit truAilo. 
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correlation' with marks at the end of Freshman year and n negligi¬ 
ble correlation with marks at the end of Sophomore and Junior 
yBftvs. Grades received in entrance examination show a marked 
positive correlation with jnnrkfl received by the end of each of the 
three college ‘years. The cocllicient of correlation for entrance 
grades and marks received in academic work is almost twice as 
large as that for I, Q.'a and marks at the end of Freshman year 
-and is more than four times as large as the cocfilcient of correla¬ 
tion for L Q.*3 and college marks nt the end of Sophomore and 
Junior years and at the middle of Senior year/ 

The results obtained from correlating the two intolligencG teats 
used with Group II with marka received in academic work, and 
■entrance examination grades with college marks nro presented in 
Table II. I, Q.'b show a positive but low correlation with college 
marks nt the end of Freshman year (.I97±.064) and at the end of 
Sophomore year (.166±,070), Thuratono Test Scores show a 
higher correlation with college marks at the end of both years than 
do I. Q/a. The correlation between entrance grades and college 
marka at the end of the Freshman year is .520±.048 and at the 
end of Sophomore year is ,486±.05B. 

TABLE n 


No. of 

students r P.E, 

103 Entrance grades and marks end of Freshman year .520 .048 

88 Entrance grades and marks end of Sophomore year .486 ,056 

103 Entrance grades and 1. Q. ,190 .064 

103 1. Q. and Freshman marks .197 .0G4 

88 I» Q, and Sophomore marks .16G ,070 

103 I. Q. and Thurstone Scores .223 .063 

103 Thurstone Scores and Freshman mai'ks .274 ,061 

8B Thurstone Scores and Sophomore marks .293 ,066 


Here, ns with Group I, entrance grades show a much higher 
correlation with Academic success than do the scores in either of 
the Intelligence Tests. 

The results from Group HI are presented in Table III. En¬ 
trance grades correlate .638±.039 with marks received in the 


clriSHincntloii fnlliMvnd lioro Is lUiffpr'H. Hliffg, 11. O. RLn tint leal 

Mi'tluxlH Aprllua lo I'Jdiieallcm, n. 2j(|. (lIouehLnu aiUHlii Co, 1017,) 
TIio imirlu'd iIccn'iiKO In tin* hIzi* ot tlnj roMdllcltiiiL lioyoinl lliG I'^rorth- 

inrin yoiii’ iimy ho o.vidiilDod In pact Uy ilio faol (Inn a iiiiiulior ol’ HiudoJits 

low in both griules iinO r cores In intelllBencu I oats wltlidnnv al the end 
of tliG FfGaliiiiJin year. Tliia does not, iiowcver, aceouiil for all of Llic 

'Cliangc. 
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IHreghmEin year while Thuratone scores show a correlation of .347 
±.0B8 with Freshman marks. 

TABLE III 

No. of 

students j. pjj 

104 Entrance grades and marks end of Freshman year .638 .039 

104 Tliuratone Scores and marks end of Freshman year .347 .068 
104 Thuratone Scores and entrance grades .298 .060 

The results presented in Tables I, II and III show that of the 
three Measures on which prediction of success in the Freshman 
year in college might be based, grades in entrance examinations 
rank first, Thurston© Test scores next and I. Q.*s last. In the case 
of the last two measures the difference between the sizes of the 
.correlation coefficients in the one group to which both tests were 
administered in 7.7 points at the end of the Freshman year and 12,7 
points at the end of the Sophomore year. No one of the three meas¬ 
ures show a correlation which may be regarded as ''high^' accord¬ 
ing to Rugg^s Glassification except in the case of entrance grades 
.and Freshman marks in Group HI. 

A study was then undertaken to determine whether the records 
in intelligence teats might have been used to exclude students who, 
although able to pass the entrance examination, made unusually 
poor records in college. Each group was divided into quarbiles 
according to rank in college marks. Table IV shows the distri¬ 
bution in quartiles according to rank in college marks of the stud- 
dents at or below the 25th percentile in entrance grades, in Tliur- 
stonc scores and in I. Q.*a. In the case of Groups I and II a low 
grade in entrance examinations is more indicative that the student 
will do less than average work in college than is a low score in 
intelligence tests as is shown by the fact that a larger per cent of 
the students ranking below the 26th percentile in entrance grade 
rank below the 2Bth percentile and median in college grade. Of the 
students ranking below the 26 percentile in I, Q. in Groups I 
II, 47% rank below the median in college grade at the end of 
Freshman and Sophomore years. Of those ranking below the 26 
percentile in Thurstone scores 60% rank below the median in 
college grade and of those ranking below the 26 percentile in 
entrance grade 70% rank below the median in college grade. In 
Group III the intelligence test and entrance grade select the 
poorer students almost equally well, but the Thurstone test shows 



334 


ARLITT 


TABLE IV 

DiaTUinUTION IN HANK IN COI^ruEGTO MARKS. 



Na. Bill dun ts 
below 27) per- 

No. below 

No. be- 
Lwncii 2,1 

No. be¬ 
tween 00 

No. nbovQ 

Group 

cenLlleln Ycnr 

27) 

iliMl 30 

and 70 

7.1 per- 

IntcUlgence 

rcTcentlle 

porcontlltt percentUo 

centUD 

I 

Quotient 

24 Freshman 

9 

G 

G 

3 

I 

18 Sophomore 

6 

9 

5 

6 

II 

2G Freshman 

0 

5 

8 

7 

II 

21 Sophomore 

3 

5 

7 

0. 

I 

No. of fitu- 
(Icntb below 

2,'j p(>re«‘ntllc 
in Enttnncc 

Examination 

24 Freshman 

10 

9 

3 

2; 

I 

17 Sophomore 

7 

6 

4 

1 

II 

26 Freshman 

11 

6 

7 

2. 

II 

21 Sophomore 

9 

5 

4 

3 

III 

2C Freshman 

10 

9 

7 

0 

II 

No. 'below 23 
porcentllL* In 

Tiuiratone 

Score 

26 Freshman 

7 

9 

7 

3 

11 

22 Sophomore 

S 

6 

G 

3 

III 

26 Freshman 

10 

11 

3 

2 


itself to be slightly superior to the entrance grade. Of the students- 
ranking below the 26th percentile in Thurstoiic score 80% rank below 
median in college marks as against 70% in the case of those rank¬ 
ing below the 26 th percentile in entrance grixdefl* 

As a final test of the selective capacity of the three measures, 
a compaviaon was made of the standing in college of the aix 
students ranking lowest in entrance grades, the six ranking lowest 
in 1, Q., and the six ranking lowest in Thurstone scores in each 
group. This represents approximately the lowest 0% of the 
group. Of the six students ranking lowest in I. Q. in Group I 
three were below the 26th percentile of the class in college grades, 
two were “between the 26th percentile and the median, none between 
the median and 76th percentile and one above the 75th percentile. 
Two of the three students below the 26th percentile were dropped 
at the end of Freshman year because of poor work. None of the 
six lowest in entrance grades were dropped and only one of the 
six was below the 26th percentile. 

The six students in Group II ranking lowest in Thurstone score 
were distributed as follows: one was below the 26th pevcccntile,. 
two were between the 26th percentile and median, two were between 
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the median and 75th percentile and one was above the 7Bth percen¬ 
tile. Of tliG six ranicing- lowest in I. Q. two were dropped at the end 
of the year because of poor work» two were between the 26th per¬ 
centile and median and two between the median and 75th per¬ 
centile, Of the six ranking lowest in entrance grades two were 
below the 25Ih percentile, three between the 2Bth percentile and 
median and one between the median and 75th percentile. None of 
the six ranking lowest in entrance grades were dropped because 
of poor work. Of the aix students ranking lowest in Thuratone 
score in Group III one was dropped because of poor work, and of 
the six lowest in entrance grade one was dropped. 

Although the ThursLone Test is, as has been shown by its corre¬ 
lations, a better measure on which to base prediction of success in 
college than is the I. Q. and although entrance grades is a better 
measure on which bo base prediction of success in college than is 
the score in cither of the intelligence tests, the 1. Q. selects the 
students who will do the poorest work in college better than doea 
either the score in Thurstone Test or the grade in entrance examina- 
tioiis. A study, however, of the distribution by qiiartiles in rank in 
college grnde^of the six students lowest in intelligence tests will 
sejTC to show that to use the I’csults of such tests to eliminate 
students who have passed the entrance examinations would be 
nmnifestly unfaii\ 

The result of our tests show three things (1) that neither the 
Thurstone Test score nor the L Q. correlated as highly witli marks 
received in college as did grades received in entrance examina¬ 
tions, (2) that the Intelligence Tests could not with fairness be 
used to exclude students who had passed the entrance examina¬ 
tions since a large percentage of the students at or below the 
25th percentile in Intelligence Test score do adequate college work 
and less than half of the lowest five per cent in Intelligence 
Tests are excluded from college for poor work, (3) that the I. Q.'s 
selected the students whose work proved poorest, better than did 
the on trance examination grade or the score in the Thurstone Test. 

That our results are in no way unique can be seen from a com- 
pavijiion of our results with those of previous investigators in 
the same field. The following table cited from Caldwell brings 
together the data from a number of such studies. 

The cocfTicient of correlation between coUeg‘0 marks and Intelli- 
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gcncG tests ia shown in the column ot the ri^ht. 
Wiasler 

Galfce ‘23 

l^owltMul and Lowden ,37 

Wtiu|?h *41 

Bell ,31 

Ititson .44 

King nnd McCrory .30 

Cnl dwell .44 

To the above table may be addeil the following'. 



Year 

r No.stiidoiiLs 

Tests used 

Caldwell 

Sophomores 

.17 

24 

Stanford Revision 


Junior 

.G9 

24 

Stanford Revision 

Kitson 

(Second group) 

.20 

40 

IC Selected Tests 

Bogers 

Seniors 

.42 

92 

Thorntlihe Mentnl 
Alertness A. 


Seniors 

.39 

92 

Thorndike Mental 
Alertness K. 


Freshmen 

.37 

182 

Thorndike Mental 
Alertness A, 


Freshmen 

.37 

182 

Thorndike Mental 
AlcrtnoKs K, 


Freshmen 

.23 

182 

Ruftsoniug I Roger a 


Freshmen 

.12 

182 

Reasoning la Rog. 

Colvin 

Freshmen 

.5981 

103 

Brown U, Testa 


Freshmen 

Am 

210 

Army Alpha 


The cooniciont of currolation in the studies cited in wliicli tests 
other than the Stanford Dinet were used ranged from .01) to .59 but 
in moHt in.sLances varies by not more than ten points from our 
results with the Thurstone Teats. The only results comparable 
with cm vs for the Stanford Bin el are Civh! well's, llcvc the 
coefheient of correlation for Sophomores was about the same aa 
that in our results for Sophomores in Group II hut the coefficient 
of correlation for Juniors was much larger than ours due perhaps 
to the difference in the size of the groups. 

The fact that in our study acorea in intelligence tests and college 
murks do not show closer agreement may be cxplnincd in several 
ways. In the first placer as has been pointed out earlier in this 
study, the students dealt with are a highly selected group from 
which the less able individuals have been for the most part elim¬ 
inated by failure to puss the entrance examinations. All but seven 
of the 201 students given the Stanford Binet have I. Q.'s above 100 
and the large maiority of the students have mentol ages above 
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sGvmitecn. As to Thurstanci scoics the lowehL sUulent in Gvottp II 
scores ttt the VJih |)L‘i‘cenlilu acuordiiiff to the norms for this teat. 
The lowest student in Group III also scores at the iOth percentile. 
The level of intnlliKUiice hi the case of practically every student 
is hi fill cnou^^h to warrant lul equate work in collegG if interestj 
habit of work and Uie necesHiiry preparation are also present. 
Factors other than inlrllij^enco may therefore play a large part 
in the stmlont’s success. 

In the secoml place very intelligent students have often not been 
ti’ained to worlt ti> the limit of their capacity in the lower schools. 
Their mental level has been high onough to enable them to do 
fairly satisfactory work with a minimum of effort. These students 
enter college with inadequate preparation as shown by low grades 
in entrance examiniitiona and with the habit of working only 
enough to “get through." If Lhia habit persists through all four 
college years it may load to n very intelligent studenVa receiving 
poor marks, 

In the third place some of the most intelligent students are not 
interested primarily in coUoge work, and unless pride in academic 
success is sufTiciont to make these students put forth a deter¬ 
mined cITorL to npLain high grade.? most of their energy may find 
its outlet ill extra ciirriculum nctivitio.?. 

Lastly the low correlation between tho two intelligence testa 
u,sed hy us (.223) .suggests that the validity of one or perhaps 
of both as tests which will dlffeventiaic between mental levels in 
adults may not be aa great aa could be desired. It may well be 
that we are expecting more of the tests of college students thmi 
we have expected of teats of children below fourteen. Our pi’oblem 
here i.s Chat of difl'orGntiaUng between abilities nt the top of the 
scale, a fiir more di Hi cult one than that of separating into groups 
the whole range of mental ability. It is probable that this problem 
will I'cquirc as many years for its solution as elapsed between 
Binct^g first experiments with the thirty tests in his original series 
and the publication of the Stanford Revision of the Binet Tests 
ill 1915. 

Full cooperation of college authorities and experimenters in 
the field of adult testing will, it is to be hoped, produce testa 
fls valuable to the college as the Stanford Revision of the Binet 
has been to the lower schools. 
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A RE-INTERPRETATION OF THE STATISTICAL 
METHOD OP ARMY TRADE TESTS 


By Artiiuh W, KonNiiAUSEji 
Univcrflity of Chieafiro 


Tlio proccclai'c followed by the Army Trade Teat Division in 
the consti'uction of oral Irndc teats has been described in several 
books nod articles'. We aha II, therefore, include in the present 
paper only n brief summnry of the atntistical method used in 
the trentmont of test questions, This will serve ns a basis for 
our critical discusBion, 

Tor each trade question on which standardization data were 
collected, a graph like that shown in Figure I was constructed, 

The question is scored from 4 to 0, for a correct answer, 0 for 
incorrect, and intermediate scores for partially correct answers^ 
In the graph the scores are read in the column to the left, while 
across the top nre arranged the four trade classes—Novice, 
AppTcnticG, Journeyman, nnd Expert. The number of men of 
a given trade status making each score is entered in the table. 
Thus, 2 Novices scored 4; 8 Apprentices scored 4; 18 Novices 
scored 0; and so on. Twenty man of each class of ability are 
represented in the grapli. The average score for each class is 
obtained and enlercd at the foot of the chart. These averages 
are plotted nnd a curve drawn to show graphically the relation 
between trade iitaUrs and acorc. On the basis of an inspection of 
these graphs queaLions were retained or eliminated, 

Prom those questions which were selected as showing suilicicntly 
“good” graphs, tlio ones were retained which, in combination, 
Would give the best discrimination between Novices and Appren- 
ties, Appreiiliees aiul Journeymen, and Journeymen and Experts, 
Tile final lest consisted of some ten to twenty questions, the 

combined score on which was then used in classifying the individ¬ 

ual tests. 

We Film 11 attempt to examine critically both the treatment of 
individual trade questions and the method of combining and using 
these cjLiesticins. The first—^tlie manner of evaluating questions— 

'Tlio ’ivihoniU'i of llio Unltcrl Anuy. Wiushiiifftoii; 

AOJnOnu I})!?). r*)i;ii)U‘i’ -ir 

J. C!, CMniaiauii. '1 'pkIh. >J(’w York: Holt, l&'-l. 

Adaihoiitil ri‘r<*ri‘n(*i\s iiiiiy lii> r(nih([ In Iii«t Jiiciitloiiotl fiook. 

-IMi’lljiJ ricoref,' a/►re r/uv‘lr ij.^crJ la jifhoil priietlco. iNonc arc pveBt'nt 
III i>ur llhiwlranoo. 'riii'iiiiirluuit lhi‘ iiroHOiit imrcH’ wo shiiU cntlnuy 

Imu.iT pni'tlnl H.-oiT« IIml hIoiII s^oak of inunJug and faning /iK tlic oiilj 
ahi'i^iiol ivi^.v. 
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requires a statisticul vc-intcriivctatian. The second, which has to 
do with the form of the test as a whole, is principally n matter 
of convenience and practical usefulness, 

The method of evaluating the indivicUml questioua appear at 
once to be open to criticism regniVling the statistical logic 
employed, The procedure makes use of the wrong regression line 
in considering the relation of ability and score. The inquiry 
made by the technique used is: What are the aver ago scores 
made by tradesmen of the sevorai grades of ability? Tho proper 
question would he: Whafc is the average (or most probable) 
trade status of tradesmen making a particular score on a question? 
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Figme 1. 


On more careful examination, however, it "will be found that 
while the procedure described does plot the wrong regression line, 
actually that regression relation is not used ns a jneans of pre¬ 
diction. The regression equation that is, is not made use of 
either explicitly or implicitly. 

In order to make clear the indirect use to which the regression 
of BcoTe on trade status is put, wo shall llrab discuss the logic 
underlying the evaluation and combining of questions. It will 
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then bo noted %vhercin the Army method meets, and wherein it 
docs not meet, the .sliiLLsticiil requirements. 

The problem which wc have, if wc ask how well we can 
iictunlly predicl triulc status from score on the individual question 
nifly be formulated more dtdhdtely thus: AVhat are the numerical 
odds that (I niari piissiiitc (or failing) a question ia of one trade 
status rulher than unolhor ? 

A loj^ical proceduro for <letei*mining these odds follows*. 

X .V \ -V 

(1) Lot n , 3t , J , and o reproscnl the numbers of Novices', 

Appronticc.s, Journeymcji and Experts respectively 
who take « i^iveii question,x, 

X 

(2) Assume that n - u = j = e . 

(This is done in practice by using porcenhages, i. e.,, 
by referring results to a basis of 100 individuals in 
each trade class.) 

X \ \ X 

(3) And lei n , u , j , and e represent respectively the num- 

r r r r 

hors of Novices, Apprentices, Journeymen, and Ex¬ 
perts who give a ^'right^"^ answer to the question x. 

\ X X X 

(J) Similarly ii , a , j , and e represent the numbers who 

^v’ ir \Y IV 

give a *'wrong'* answer to the question. 

X X 

(6) Then clearly, the ratio of a to n expresses the odds 

1’ r 

that n man pasaing question x is an Apprentice 

X- ,\- \ X 

rathor than a Novice, assuming n — a = j = e . 

X X 

(G) Corresponding alalemonts hold for the ratios j to a 

r r 

X X 

and 0 to j , and for ratios using percenlagea of 
r r 

failures in place of successes. 

Now these numerical expressions of the odds constitute pre¬ 
cisely the sort of relations we desire save, of course, that we 
must ill practice take into comsideration the actual ineqiuiUty of 

X X X X . . , 

a , n , j , and e . The proper allowance for these inequalitms 
can be made only on the basis of data which will indicate roughly, 
at least, what the proportion of Novices, Apprentices, Journey- 
men, and Experts are among men actually applying for employ¬ 
ment in Lhc given situation. 

(7) If now, N, A, J, and B represent the actual numbers of 
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trncloamen applying, 

X 

A n 

r 

( 8 ) Then, - X -= the odds that a man who passes 

X 

N n 

r 

question x ia nn Apprentice rather than a Novice. 
That ifl to sny, the forniulnlion of (5) must be 
corrected by wcightiiie the itenia in accordance with 
the actual number of Novices nnd Apprenticed who 
are applicants. It is to bo especially noted that 
for the purpose of comparing one (lueation witli 
another the weighting is wholly iinnecGS.snry. Since 
it remnina constant, the leialive merits of qvmstions 
can be judged quite us well by using simply the 

X 

n 

r 

ratios of the typo, -. 

X 

It 

p 

The expression (8) stands, then, ns the general answer to our 
tfuestion, by stating uimpiy what the odds arc, that n man passing 
a question is of one trade status rather tlian of anoLlier. Cor- 
rGHpondiiig expressions may readily be written for other chiss dif¬ 
ferentiations and for ailuiLtious in which the answer to the trade 
question is wrong instead of right. 

Let us now return to the Army procedure and examine it in the 
light of the preceding discussion. When the-average score on a 
question was obtained for each trade class, wdiat was really secured 
fas is evitlent from the nature of the compxitalion) was the per¬ 
centage of the clus.s Avho pas.scd, iiiiiltipliod by a coins La nt factor, 4. 
The regression line that was graphed, therGforo, may be thought 
of simply as a curve showing the pev ecnls of individuals passing 
aL siicce.ssive trade levols. 

To the extent that the regression line or curve of i>er cents was 
of use in comparing the percentages of passes at adjacent trade 
status levels, it possessed a certain value in indicating tiu; proper 
sGlection of qiiostioiis; to the extent that it gave a false notion 
of the relative excellence of dilferoiitiation at tlie several levels, 
it was uiisalisfactory. The sharpness of rise in the curve between 
two groups was considercd the significnnl fact. IMic height of Uic 
point from which the rise takes place play.s an important part 
which was not sunicionLly considered in the Army procedure. 
Consider this point in greater detail. As indicated in our the (ire- 
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fliflcusaion, the critical expresaiona for determining differ- 

X 

a 

entlfltion are the ratios of tho ty pe, t This ratio can 

X 

n 

r 

be ohtnined directly from the curve plotted for each question in 
the old procedure. For example, (»SGe Figure 1) if the curve 
rises from .4 (Novice average) to 1,C (Apprentice average)^ the 
desired ratio is 4 (i.c., 1.0 divided by .4). In Army practice this 
ratio was not rend. What icas taken as a criterion (usually im¬ 
plicitly, through e.stimated steepnc.^.s of the curve) ia the absolute 
diffcrencQ between Huceesaivc points on the curve in the example 
just given, 1.2. Suppose, now, that the next point on the curve, 
llic Journeyman average, was 2.8. The absolute difference and 
the steepness of the curve remain constant; but the ratio which 
wns 4 fit the first division is 1% nt the second. Actually, that 
ia, the question diHerentiato.s very much better between Apprentices 
mid Novices than between Journeymen and Apprentices^ although 
tijc Army method of analysis .shows equally good differentiation. 

The shortcomings of the Army procedure can, perhaps, be 
made clear by referenco to n few sample graphs of questions. 
These are .shown in Figure 2, A man passing question B re¬ 
ceives tiui same credit ns one passing A, even though passing B 
is almost certainly diagnostic of Expert status whereas half tho 
men pnssing A are not Experts, one sixth actually being Novices, 
Question C is considered a good Journeyman question; D is re- 
jeeted. Note, however, that passing of D moans that a man ia 
practically certain to be cither Journeyman or Expert while pass¬ 
ing C gives a much lower probability. Tho same is true for failure 
on tho question. E illustrates the sorb of question discussed in 
tile preceding paragvnid^, A man passing this question ia four 
times as likely lo he an Apprentice as he is to be a Novice, while 
ho IS only two and a half times as likely to be a Journeyman as 
ftn Apprentice. NevcrLhele.ss, this question is considered a Jour¬ 
neyman (lucslion simply bocausG the curve rises more sharply 
it that level. 

In concluding this discussion of the Army procedure a word 
a to be .said regarding the .satisfactoi'y (on the whole) results 
obtained. Two prime requiremmits for Army trade tests were 
jpoed of production and simplicity oi administration. These re- 
Vuu'cments wei'e met by the technique us-cd. Any slight gains in 
4cciirficy Chat could have been jiiade tbrough more refined sfcalis' 
•ical treatjnenL, it may well be argaied, would not have hebn worth 
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the trouble. The fnirly ffood rcaulls that were obtaiiieil by rough 
methods were in part due to the following considerntiona; (1) 
Questions were combined that did show good difTerentiation at 
the several trade levels. The d’llYcrcntiatioii was satisfactorily 
shown by the inexact method for the reason that ordinarily very 
good differentiation occurred at only one class division and this 
division point could be detected by mevely noting the rise in the 
curve. Hence good results were secured though it seoin.s reason¬ 
able to believe that the same quality of results might have been 
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obtained with shorter tests and less waste of questions. (2) Since 
a fairly large number of questions was asked, the errors made in 
crediting separate questions were likely to be compensating. 

The conclusion that the Army method of evaluiiting questions 
was at fault and that the practical choice of questions was to some 
extent adversely influenced by the statistical method utilized 
appears to be justified, The question at once arisos whether a 
more satisfactory trade test method can be built, using the sort 
of statistical foundation we have outlined. The remainder of 
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the pfiller wilt be dcvoted to some tentative suggestions for a 
tyjie of trade test which does make use of the method presented 
for the evaluation of .single questions, and which will at the same 
time have ccrUiiJi advantages as compared with the Armjr tech¬ 
nique in the manner of the combining and using of questions. 

The Army nnil trade test consists of a fixed list of questions with 
norma eatablialiod for the Lotal list. A method of test construction 
which woulil niiike possible the Lreating of individual questions as 
fltandardizofi units, in place of having the entire test as the stand¬ 
ardized unit, would have decided advantages in point of practical 
usefulne.s.f. Among the advantages are; (1) The test may he 
made more brief when desirable. (2) It may be varied to prevent 
coaebing and to allow for unusual circumstances. * ,(3) In test¬ 
ing the examinee it is unnecessary to give questions of all de¬ 
grees of difficulty; that is, questions less difficult than those already 
passed nee{l not be given, nor questions more difficult than those 
already failed. (4) The test may be continually developed by the 
incorporation of new questions, standardized in connection with 
the ii.se of the existing question.^, (5) Questions which prove 
undesiraldc for any reason may be dropped without necessitating 
any change in the remainder of the test. 

In addition to these practical advantages listed, a system of 
trade test construction based upon the theoretical discussion in 
Part If, would have a more logical statistical foundation than have 
Army trade tests. 

What, now, are Iho difHciiltie.s in the way of a new trade lest 
moLhod of the sort we have been pointing toward? Is it possible 
for us to lay down some definite suggestions as Lo the form of a 
trade test built on the single question basis and to outline a mode 
of procedure? The answer is that there exists one most formid¬ 
able obstacle, namely, the absence of a sound method for com¬ 
bining the results from the single questions. Concretely, how 
shall wo combine the ratios showing the odds in an example such 
as tile following? Let us say the applicant is given five questions, 
three of which arc passed and two of which are failed. We have 
the following odds from the several questions j Question 1 
(passed) shows that his chances of being Apprentice rather than 
Novice arc 9 to 1; question 2 (passed) shows that his chances of 
being J on nicy in an rather than Apprentice are 7 to 3; question 
3 (failed) shows that his chances of being Expert ratliei' than 
Journeyman are 2 to S; question 4 (passed) .shows that his chances 
of being Journeyman rather than Apprentice are 8 to 2; and 
question B (failed), shows that his chances of being Journeyman 
rather than Apprentice are 3 to 7. What, now, are the probabil- 
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itiea that this individual is n Journeyman^ judging on the basis 
of all the questions? 

The usual way to combine probabilities in answer to such a ques¬ 
tion is to multiply the ratios. Thus, in coin tossing, for oxfimpie, 
the chances that one coin will come up heads is 1/2; the chances 
that two coins will come up heads at the same time is 1/2 x 1/2. 
Applying this sort of method to the above example, we would 
obtain tlie combined odds from the five (iiicsLiona by multiplying 

0x7x2x8x3 9 

the ratios given. Wc would have, that is-—. 

Ix3xax2x7 1 

But this gives false results. This multiplying of probabilities is 
based upon the assumption of iiidependencG (lack of cor relation) 
between the several events. However, the passing and failing of 
particular trade questions is clearly not luicorreiatcd with the 
passing and falling of other trade quostions. It might appear 
at first that we could correct for the inter cor rein Lions among 
questions by means of the partial correlalion procedure. This, 
however, is impossible because of the inapplicability of llic partial 
correlation method in the case of ncin-linoar regressions. That 
the regressions of trade questions are not linear was clearly dem¬ 
onstrated by Army experience. The writer Icnow's of no way by 
which this problem of combining probabilities from dilYorent trade 
questions can be handled in a thematic ally. 

Wc apparently, then, are forced into a position wliere we must 
either abandon the proposed sort of trade test or find sonic make¬ 
shift for combining que.stions. Wc shall briclly state one or two 
tentative suggestions in the latter direction. An empirical proce¬ 
dure for combining individual q lies Lions, even though it fall far 
short of what would be Iheovetically desirable, may nevorLUeloss lie 
siifTiciently vnhuible to warrant the u.sc of the proposed .sort of 
trade test. 

We shall mention two possible lines along which an empirical 
procedure might bo dove lop eel. The ossenLinl requirenieuL is Unit 
clue provision bo made to guard against the use of many closely 
iiit<»rc(>iTclated questions in the examination of an individual. 
This may be accomplished either (1) by classifying appropriate 
questions into fixed groups placed at s<‘vcral level a oC diniculLy 
(analagous to Binet age groups), or (2) by having at each level 
a large number of questions which are sorted in to classes of (lucs- 
tioii.s having rela Lively low correlii Lions wUh ([lies Lions in oLiior 
classes. 

The first of these suggested possih ill lies has some, biiL not all, 
of the advantages earlier nieiiLioncd as cluiracterisLic of a test 
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which would flexibly combine single standardized questions. In 
this method wo would have n comjDromise between the standardized 
single question and the standardized complete test. Here, the 
whole group of questions at the Apprentice, Journeyman, or Ex¬ 
pert, level must be treated as a unit. This trade level form of 
test, while somcwiiiit similar to the Binet age level method, has 
several significant dift'crenccs. Among these are the following: 
(1) Questions nre placed at the level where they clifTerenLiate 
best, not where a certain per cent of the individuals tested have 
passed. (2) QuesLion.s arc weighted in proportion to their cliffer- 
cnLiuting value; i. e., on the basis of the probability ratios earlier 
discussed. (3) Questions are weighted differently if passed and 
if failed. (Those modifications would appear to be applicable to 
nge-lcvel tests like the Binet as well as to trade tests,) 

The second suggestion of n procedure for trade test construc¬ 
tion lias certain advantages over and above those of the fixed 
trade level grouping just considered. It is essentially the same, 
save that greater flexibility is introduced in the use of questions. 
It carries very mucli further the idea of alternative testa which 
have been placed at some of the age-levels in revised Binet tests. 
In place of having a fixed set of questions at, say, the Joiirney- 
mnn level, we have a great many questions. These are classified 
according Lo the divi.sions into wliich trade knowledge in this trade 
has been analyzed. In examining a candidate, the questions 
which are asked at a given trade level are chosen from the 
several classes into which the questions at that level have been 
dislriinited. This method appears to be a feasible empirical de¬ 
vice Lo jn‘event a candidate's being judged upon his answers to ca 
non-roiire.sentuLive and highly inter correlated set of questions. 

We shall not enter into a description of the detailori methods 
of weig'liLing, scoring, and combining scores, which would be used 
in the suggested procedure. SufTice it to say that the actual pro- 
babilitiCvS calculated for each question can be Iransmiited into 
simple ‘'weights" (consisting of miinbers proportional Lo the lo¬ 
garithms of the ratios of odds) which may then, lit each level, be 
readily added. The sum of the "weights", regardless of the 
number of question.'? asked, will give a rough indication of the 
odds that the candidate is at that level or below it, based upon all 
the quc.sLions asked at that level. The questions are, of course, 
in this way being used as though they wore not intcrcorrelahed. 
For adding the logarithms is equivalent to multiplying the ratio 
and this is the theoretically correct method of combining pro¬ 
babilities when the events are un cor related. The composite pro¬ 
bability that we got is, therefore, only a very rough approximation. 
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But inasmuch os the questions Imve been clossificil into groups 
not closely correlated with questions in othov groups, (iml inasmuch 
as the combined probabilities will be thrown off in about the snmo 
degree niid in the same divucLion for all cnnduliitcs, the procedure 
appears to be usable. Wc again empliasizo, however, that the 
method is offered only us a tentative suggestion, a iniilceshift pro’ 
ceduve which may have ndvantugcs over the rigid type of Army 
trade test. 


IV. 

Wc may briefly summarize n.s follows; 

1. The statistical procedure used in building Army trade tests 
appears to be open to criticism on the grounds tliut Elie regression 
of test score on trade status was used in place of the reverse role- 
tionship. Closer consideration reveals, however, Uiat the regres¬ 
sion relations which were calculated were not used a.s .sucli. 

2. In order to make clear the indirect use of the figures cal¬ 
culated in evaluating each test question, wc have outlined, without 
referenco to Army procedure, a logical ba.sis fur evaluating questions 
in terms of the probability relationships of trade status to scores 
on single questions. 

3. The Army method was then compared with our discussion 
of n method which would use mathcmntical odds for each qiic-stion, 
and the conclusion was reached that to a certain extent the Army 
procedure was actually comparing .such percentage rntio, but not 
in a logically correct manner. The method u.sud worked tolerably 
well, but, as shown by a few illustrations, it also foiled in part. 

4. Finally, we have attempted to suggest linos whicli a differ¬ 
ent technique of trade test cousti'uctioii might follow, based upon 
the theoretical diacussion contained in the paper. The principal 
advantages of the proposed sort of tost are indicated ns well as 
the special difficulties involved. 



A CASE OF SECONDARY MENTAL DEFICIENCY 
WITH MUSICAL TALENT 

By Blanche M. Minoguc 


Before inedicine and psychology had advanced to their present 
degree of development, the obviously defective in intelligenee were 
regarded as being possessed by some superior power, The occa¬ 
sional “idiol-siivanb" with his extraordinary abilities must have 
seemed convincing proof of that theory. Modern psychological 
methods, however, enable us to understand to some extent these 
heretofore inexplicable creatures. In recent years several cases 
have been reported in considerable detail. They are usually moder¬ 
ately high grade defectives who possess special abilities, which 
stand out in startling contrast to learning ability, judgment, etc., 
which are noticeably below the average. 

Among ^'idiot-savants” are occasional musical geniuses who are 
almost phonomenaL Although musical genius in itself is appar¬ 
ently something apart from general intelligence, it involves many 
-of the Attributes of intelligence. For this reason a case of marked 
musical talent combined with low general ability is the move 
remnrltflble, Such a case is that of a male patient, at Letchworth 
Village at the present time. 

X. Y., a twenty-three year old boy, with a mental age of about 
seven years, is a pianist of marked ability. He has been in the 
inslitiilion for acveral years, and in that time has played at 
practically all of the social functions of the institution. 

The family history seems free from any intelligence defect. 
The paternal line is of normal, if not superior, mentality. The 
father's father was a broker, and one cousin, an engineer, has 
been a successful inventor. The father, born in Hungary, earns a 
moderate salary as a shipping clerk, The father’s mother is a 
pianist of exceptional ability. His sister’s daughter is also an 
unusually gifted pianist. The other members of the family, in¬ 
cluding the father himself, show musical ability in moderation. 

The nmternnl line is interesting. The mother, also born in 
Hungary, is a %voniaii of superior intelligence and refinement, The 
entire family appear to be of more than average mental ability. 
■All have achieved success in business. One brother has two 
children who were pronounced superior after a psychological ex¬ 
amination. This branch of the family shows considerable emotional 
instability, and does not give any indication of musical talent. 

The patient’s sister is a very bright, attractive young woman of 
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about twenty-one years. She graduated from Wgh school, winning- 
recognition for her schoinrshp. At present she is working and 
carrying college work in Extension School. She is a violinist, but 
does nob show unuaual talent. 

The patient was born in 1900, in the United Slates. Everything 
connected with pre-natal life was favornble. Birtli and infancy 
were normal. He was a bright, healthy child, walking nt twenty 
months and talking nt one year. As soon as lie talked Jig leaviicd 
little songs in English, German, French and Iliiiigarian, lie leavncd 
quickly and appeared to have intclligciice, a.s well as musical 
ability, far above the average. Even in infancy, however, the child 
had periodic attacks of temper. His mother describes him as very 
amiable until some emotional experieucc such as surprise caused 
a sudden passionate outburst. 

The boy developed normally until the age of three years. At 
that time ho was severely ill with pnoumonia, with complications 
which have since been diagno.sed a a meningitis. In the delirium 
of the disease he ssuig incessantly the songs he had learned. 
For many years after his recovery he showed great reluctance to 
sing. After this illness the child frequently hnd violent screaming 
spells and soon showed mental retardation. When seven years 
old he was taught nt home for a year by a special teacliev, and 
then entered grade 2A in the public schooLs. He made fair pro- 
gre.ss in rending, writing ami arithmetic, but was teased so unmerci¬ 
fully by the other children that ho had to be removed from Rchool. 

He received piano instruction for two years under excellent 
teachers but was very abusive to them. As he became older he 
often became voluble on the streets, and attracted crowds of people. 
He became the victim of iinscrupiiloti.s per.so ns in the neighborhood 
and BO was committed to T4ctchwoYth ViUiige. 

Since admission to the institution X, has not been a discipline 
problem. He does light work around the cottage, and plays the 
piano niLich of the Lime. As he is not very robust he requires 
sleep during the clay. He lacks many characteristics of the feeble¬ 
minded, His muscular coordination is very good; he walks 
briskly, without the usual shiilhing gait of the menial defective. 

X. takes great pride in his musical accomplishmcut.s. He plays 
the most diihcuU music by sight and by ear. His ability to render 
classical and concert pieces, as well as the modern is note¬ 

worthy. In a recent te.»jt before a woman of considerable musical 
training he played the Anvil Choms from “11 Trovatore,” Lohen- 
f/rin, the Tannhauser iMarc/i, Tam 7 Llella, Carmen, Chopin's Pun- 
oral J)Jareh and many other classics. He rend at sight the Mat'che 
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Grotesque by Sinding, Chaminadc'a The Flatterer,^ and Hearths 
Melody by Engelman. He then accompanied the phonograph in 
playing Hiunoresque and the Utue Danube Waltz, and had no 
diificulty in aelccting the right key. He also read at sight the 
accompaniment for a vocal soloist. His emotional instability 
obviously hns iin unfortunate effect upon his playing, but he plays 
accurately and with feeling when hia attention is focused upon 
his music rather than upon the admiration he ia exciting. The 
iiiiiaic instructor at the institution considers his technique very fine 
for his limited period of study. His pitch discrimination is 
romaiicable, and hia tonal memory unusually good. Hia sense 
of rhythm seems to be more affected by hia emotional skate than 
are his other abilities, and consequently ia more variable. The 
most impoiLnnL single factor in the boy's talent seems to be his 
memory- For time, for places, for events, for any composition 
ever learned, he bass a memory almost phenomenal. That he 
has kinaesthctic memory also, is evidenced by his habit of playing 
without looking at the piano. His ability to imitate is considerably 
beyond hia mental nge. In the Knox cube teat he made no failures. 

Unfor Luna Lely, thi.s patient is deLerioi’ating mentally. On his 
admission to the institution in 1914, age fourteen years, his intelli¬ 
gence quotient was .62, at twenty years of age, his L Q. was ,54 
(mental ago eight years and six months) and a recent test gave 
him an I. Q. of .46 (mental age* seven years and five months) by 
the Stanford Hevision of the Binet-Simon. In this last test his 
basal yeiir wius four. At the five year level he failed the '^patience'' 
test, and in the sixth year passed all but the mutilated pictures. 
At the seventh year he failed to give difTerences and received only 
half credit for tying the bow. At eight years he failed the ball 
and field and the comprehension tests, and could not count back¬ 
wards. At nine he knew the date, could make change and give 
rhymes. The subject failed all teats at the ten year level. The 
grcate.st deterioration appears to be in comprehension and judg¬ 
ment, At present he seems to fall at about the six year level in 
tests of these functions. In Burt's reasoning tests he made a 
score of i.75, giving him n rating just below the seven year leveL 
Ilis score in the Indiana University Primer scale was 42, (the 
median for six year.s is 4B.3). He was unable to go above the 
fifth year in the Portcu.s Maze tests. 

Emotioii.ally, this boy is excitable, egocentric, usually cheerful 
nnd obedient, but very sensitive and wholly incapable of a social 
existence. IIu doc.s not mix >viLh the other boys, and leads a life 
reully apart from them, although one feels that he craves comrade- 
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ship, but (loed not know how to get it. 

There nro two particularly interesting features of liia talent. 
One is hia failure to produce any original composition. This may 
be the result of defective intelligence. The other is his inability 
to leaVR to dance. He seems to have no comprehension of the 
relation of the musical rhythm to his own moveniciUs, Thia ap¬ 
parently is not dopondent on intelligence, for ninny low grnde 
defectives are excellent dancers- 

The study of this case is by no means a complete one but it 
serves ns one more bit of evidence that imisicnl ability ia q thing 
apart from "general intelligence.*' It is interesting that the 
disease which robbed the child of his herilngc of intelligence and 
inCTBased his emotional instability, left apparently intact thia 
special talent. It is poi'haps purely a matter of chance tlmt lie was 
left with one intellectual trait, his unusual memory, unimj)aired. 
This fortunntc combination of mcmoryi sense of rythm, pitch dis¬ 
crimination, etc., makes a striking talent Wore any one of thcae 
lacking, or destroyed, the whole gift would go with it. 



the FRANZ DOT TAPPING TEST AS A MEASURE 
OP ATTENTION' 


By Irene Caae Shermnn 


In hi3 "HaTulbook of Mentnl Examination Methods"^ Dr. Franz 
describes varioiia teats of attention, among them a test of the per¬ 
forin ance of ftccurnle movements. Cross section paper (2 or 4 
flciunres to the inch) is usedj *‘Thc subject is inatructed to tap in 
each square ns vniiidly as po.^eible, goinfi- to and fro,*“ The experi¬ 
menter nofccH the lime for the tapa along the particular lines. The 
test may he made with 300 squares, 20 squarea to the line. 
Emphasis is placed neither upon accuracy nor upon speed, since 
the aim is to discover variations in attention. 

In n personal conuniinicntion Dr, Franz advised the use of 10 
squares to the line with 30 lines for children* He states that the 
individual setB bis own speed, but is expected to keep up the same 
speed throughout the test, With a speed not the maximum the 
rnte can be kopL up constantly with a variation of not more than 
10%. He believes that the test shows ability to keep up progressive 
work, and abso indicates “sLick-Lo-it-ness,'* He also points out 
that the test shows the V cl alive performance of the individual at 
(lin’erent Limos, nnd does not give a comparison of different 
individuals. 

Iji ail effort to find an accurate means of measuring- fluctuations 
of atteiiLion in children* this test, with a number of so-called 
attention tests, was given to 172 unaclccted eases^ Cross section 
pajior four .s(|uares to tim inch was used, with ten squares to a row 
in a scries of thirty rows. The instructions to the child were, *Tut 
a dot in each of the so aquaves, beginning hex'e and going across 
to here (examiner indicated the distance of the ten squares), then 
coming hade on the next roW; nnd so on down to this line (indi¬ 
cating the base line which marked off the thirty rows). Do this 
as fast as you can, but be sur^ to put ft dot in each squai'e, and 
don't miss any squares.'* The time for completing each row of 
squares was taken. 

The reauUij indicated such a wide variability of performance in 
children that it was felt to be necessary to establish a more 
accurate norm than the 10% variability suggested by Dr. Franz, 

Uir. not name ihls tont, but the writer feela "Dot U-’anplnE-" 

Jk judhI rlrsrrJpl Jri* of )l. 

Slu'i)lK‘i'il Ivory, Woriffboo/; o/ .Ucjt/al fJj’aiMfiiftnon Afcl/iotia. Tlie 
MncMlIliui i'ouipiiiiy, 1U2U. 

"JhJd. 1\ Si). 

'llistlLiilo for Jnvon 11 12 Ilosuiircli, Clilcugo, Illlnoia. 
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provided the reaulta would lend themselves to such n standardi- 
zntion. 

Each child was graded by the Stanford itevision of the Binet 
test, so that a mental nge and intelligence quotient was available 
in each case. In each case the arithmetic mean, the range and the 
average deviation of time were taken, na well as the coefTicient of 
variability. In order to discover the influence of age, mental age 
ftnd intelligence rating upon performance in the test, the results 
are arranged according to these three factors, and arc presented 
in tables I, II and III, 

Table I indicates that there is n general decrease in average 
time, average range and average deviation with increase in 
chronological age. This decrease, however is not sufficiently regu¬ 
lar to make the chronological nge a basis of standardization of 
performance, and is no doubt due to the increase in speed dufe 
to better motor co-ordination which devclojia in advance in age. 
The coefficient of variability showed an even greater variability in 

TABLE I 

llRSULTS ACCOUIIINCJ T(f CIlltONOMXiTCAL ACIC 


A.gG 

Average 

Time 

Average 

Range 

Average CoefTicient No. of 
Deviation of Cases 

7-Q 

11.27 

13,9 

2.26 

Variability 

10 

9 

8-0 

12.78 

8.0 

1.65 

14 

7 

9-0 

7,B6 

7.2 

1.37 

18 

16 

10-0 

G,84 

6.G 

1.17 

16 

20 

n-0 

6.72 

6.1 

.98 

13.5 

19 

12-0 

6,62 

4.9 

.92 

IG 

21 

13-0 

6.65 

6.1 

.99 

17 

23 

14-0 

3.96 

3.4 

.5 

12 

26 

16-0 

6.1G 

3.6 

.70 

11.G8 

16 

16 + 

6,11 

3.7 

.77 

IB 

17 


TOTAL 172 

relation to age, so that it indicates no rehiLion between variability 
and chronological age. 

Table II shows the same tendency for average time to decrease 
with increasing mental age, the average range find Eivcrnge devia¬ 
tion also show this decrease, but not to such a marked extent as 
average Ume does. While this decrease ia average time is quite defin¬ 
ite, yet the differences between any two mental ages arc too snnill 
to make the average time n basis of scoring in terms of mentnl 
age, The coeflicient of variability, ns in the case of chronological 
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jxgCf shows great variation, and no relation to mental age. 

Table III indientea that none of the measures showed any rela¬ 
tion to intelligence quotient. 

Table IV and graph 1 give the distribution of the coefficients 
of variation for the entire number of cases. The median coefficient 
ia Id.YB and the inter-quartile ranges from 11 to 18 incluaive. 
That 1a, fifty per cent of our cases have a coefficient of variation 
between 11 and 18. A score falling between these numbers, then, 
indicates n normal performnnee in this teat. The upper quartile 
ranges Irom one through ten, and any score between these numbers 
would be considered nn excellent performance in this test. A 
acore of nineteen or above is considered to sho^Y a fluctuation of 
attention greater than that shown by fifty percent of our cases. 

Graphs 2, 3 nnd 4 illustrate the increased variability of perform¬ 
ance of individuals with a coefficient of variability above IB, The 
time ia more variable in subjects with a high coefficient, and they 


TABLE II 

UlUHTTLTS ACCO 111)1 NO TO MENTAL A(iB 


Age 

Average 

Average 

Average 

Coefficient 

No. of 


Time 

Range 

Deviation 

of 

Cases 

5-0 

0.17 

6.0 

1.16 

Variabijity 

13 

1 

0-0 

13.52 

10.3 

1.98 

15 

11 

7-0 

10.45 

13.7 

3.17 

23 

10 

8-0 

6.97 

5.2 

1.01 

14 

26 

0-0 

0.31 

5.3 

.97 

15 

28 

10-0 

B.42 

B.6 

.89 

16 

32 

11-0 

4,60 

3.0 

.63 

14 

14 

12-0 

4.86 

3.3 

.67 

14 

15 

13-0 

4.09 

2.C 

.43 

11 

14 

11-0 

4.03 

2,8 

.43 

10 

7 

16-0 

4.9.B 

4.1 

.89 

17 

4 

IGH- 

3.55 

2.0 

.34 

10 

4 

TOTAL 

TABLE III 

IlEKULTS ACCOIILINO TO INTELLIGENCE 

QUOTIENT 

172 

I.Q. 

Average 

Average 

Average 

Coefficient 

No, of 


Time 

Range 

Deviation of 

Cases 

60 

7,0 

5.9 

l.B 

Variability 

15 

9 

GO 

7.1 

6.5 

1.3 

17 

23 

70 

6.G 

5.4 

1.0 

16 

41 

80 

8.4 

c.a 

1.2 

14 

43 

90 

G.3 

7.4 

1.2 

16 

26 

ion 

5.0 

3.5 

.6 

11 

20 

110 + 

4.9 

4.0 

.7 

12 

10 


TOTAL 


172 



56 


SHERMAN 


table IV 

DrSTHTIlUTION OP COIiKPICI BN'l'S OP VAIirAHIUTV— 173 CASHS 


0- 1 . 1 

1- 2 . 1 

2- 3 . 2 

3- 4 . 1 

4- G . 2 

5- 0 . 3 

G- 7 . 5 

7- 8 . 8 

8- 0 . G 

9*10 . 12 

26 percentile 10-11 . 1C 

11-12 . 12 

19 - 1 ^ 19 

Median 13-14!!!!!!!!!"!!!!!!!!!!!!!!!!!!"!-.!!' 13 

14- 15 . 8 

15- 10 . 8 

16- 17 . 12 

75 porcentilG 17-18 .. 13 

18- lD . 7 

19- 20 . 9 

20- 21 . C 

21- 22 . 3 

22- 23 . 0 

23- 24 . a 

24- 25 . 3 

25- 26 . 3 

26- 27 . 0 

27- 28 . 1 

28- 29 . 0 

29- 30 . 2 

30- 31 . 0 

31- 32 . 0 

32- 33 . 0 

33- 34 . 0 

34- 35 . 0 

35- 36 . 0 

36- 37 . 1 

37- 38 . 0 

38- 39 . 0 

39- 40 . 0 

40- 41 . 1 


•equire on the whole a greater length of time to complete the 
,est than subjects with average coefficients. This difTcreiice is 
nore marked in the case of the average deviation, where the 
nensures are greatly dispersed for those coefficients above 19, 
vhile those below 18 show a central tendency around a low 
iverage deviation. The mode lor those making an excellent 
jcore (3-10) is .1 while the mode for the average group is soine- 
,vhat higher, nnmely .7, The rnnge of lime taken on the lest is 
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ilso hig-bor for Lho.sc with coe/Tjcjenia jibove 18, being more widely 
Jistribiitcd than thti incnsiire.s for tbo lower coefficients, whi<!h as 
in the case of aver age deviuLion, show a marked central tendency 
around n low score. These graphs clearly sliow that a high 
coefficient of variiibility is accompnnled by increased total time 
of performance, incroaaod runge of tiine from line to line^ and in¬ 
creased deviation from lino to line, Since it has been shown 
above tliiit the coelVieieiil of varinbility ia independent of age, men¬ 
tal age and iiiUdiigence qiiolicnt, it may be assumed that the 
variability of the cooHicient is due to some other factor, presum¬ 
ably fluctuations of the utLention. 

Graph 0 illiuslrutcs the typical kinds of performance on this 
teat, The first curve has a coefficient of variability of 4, v^hich is 
superior performance. The average time is five seconds, with 
long periods of no variation from this average time; there are 
no great deviiiUons from the average from line to line, nnd the 
total range of time ia only two seconds. The second curve ia 
that of an average performance, with a coefficient of variability 
of Id. The average time is also live seconds, but there are no 
long period.s of unvaried performance, although on the whole 
the deviations are slight. The total range of time, however, is 
five seconds. Curve three is a curve typical of a high coefficient 
of variability, in tins case 20. The average time here is 13 seconds^ 
with no periods of invariable performance. There are constant 
deviations from the average from line to Une^ with a wide total 
range of time, namely, 16 seconds, 

In the giving of tho tests it was often noticed by the examiner 
that children frequently varied the. size of the dot, began making 
circles, heavy dots, two dots in one square, etc. This was often 
interpreted as due to low chronological or mental age, or to low 
general inlGlligence. Since the results showed no relation between 
these factors and the coefficient of variability, a study of the dot 
patterns wns made. This revealed that the variability of tho 
size of the dots had little relation to the score. Subjects who 
changed from a large dot to a small dot, or vice versa, did 
not necessarily make a poor score. In fact, many cimiiges in 
the size of the dots occurred with no change in time from line 
to line. On the other hand, many subjects who made very 
poor scores sliowed a marked regularity in the size of dot. In 
only one case was there a definite relation between size of dot 
and increased time. This case, scoring IB, had a marked 
increase in time in two lines, with a change in dots in these lines, 
making circles instead of dots in these two instances. On the 
other hand, of six cases showing lines with marked increase of 
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ime with increase In size of some of the dots in this line, all of 
heae ceaes alao had other lines with increased rate of time and no 
ihanee in size of dots or other variations. While it ia posaible 
hat n change in the size of the dot may mcnn n ahift of attention, 
t is almost inposaible to say definitely that this is true, because 
if the large number of casea in which there wna no evident re- 
ation between time and size of dot. Changes of time are just aa 
ikely to occur where there are no changes in size of dot as where 
here are such changes, and on the whole these changes in size 
if dot arc considered as insignificant compared with other un- 
[nown factors which are producing changes in attention. In fact, 
t is believed that these changes in ai7.e of dot nve but one of the 
xternal mnnifeatations of the variability of attention, relatively 
inimportnnt, since they seem to influence the total scoro very 
ittle. 

The records of the cases were analyzed in order to discover, if 
lossible, any factors in the subject which might cause, or be cor¬ 
elated with unstable attention. Because of Iho subjective nature 
if the analysis of the individual cases, with the marked lack ol 
orrespondence of descriptive terms used in the various records 
n presenting the history and mental analysis, a limited number 
if terms were arbitrarily selected ns possibly having some re- 
ation to attention. In cases designated ns nogntivo none of these 
iescriptive terms occurred. 

In Table VI the individuals are classified under the descriptive 
erm which most nearly described them; the pcrcontago difltri- 
lution is given according to cocfUcicnts of variability. The table 
hows that the smallest percentage of individuals with a negative 
liatory occurs in the group with scores of 19 or above. This same 
jroup also showed a larger percentage of '‘irritability,” "distract- 
bility,” “incoherence,’* and marked “slowness of reaction” than 
lid the other two groups. Subjects described merely ns nervous 
.nd restless were found not to show poor attention as menaurod by 
his test. It was also striking that individuals described as being 
loor in attention by various examiners or other observers in the 
lome or school were not characterized by making an unusually high 
core, i. e., B% of these subjects made coefficients from 3 to 10, and 
ike wise 5% made coefficients of 19 or above. Similarly > subjecta 
vith organic brain disease or psychoses were not characterized by 
t high score. Rather, the larger percentage of these were found to 
nake an excellent score, namely 3 to 10, and were able to sustain 
ittention over a short period of time, such aa ia demanded in tills 
esL 
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TABLE VI 


PimCRNTACE 

disthibution op type 

OF CAsm. 

ACCOJIDINU ' 

ro COI5I 

'PICIKNT 

OF VAJlIADILfJTY 

CoPliJClont 



Nervnua 


Ilyp^ractiva. 

af 

Vftrlnljlllly 

I’finr 

Nopnllve AlLoiUltin 

a M rl 

llQallortH 

Uiifilablc 

Distmctlble 
Irritable And Flighty 

3-10 

d 2 . 19 & 

6.3 

18.4 

7.9 

2.G 2,60 

ii-ia 


3.2 

9.6 

1.0 

0.6 3.21 

19 -h 

28.2% 

6.0 

12.8 

7-7 

12.9 7.70 

■CoL'ETlcloiit 

llniTihlln^ 





ot 

and 





Vrirliihiniy 

liH’ulirrenl 

Slow 

Apathetic 

pHycliotlc 

No record Total 

3-10 

2.G 

2.6 

6.3 

7.9 

2.6 99.0 

12-13 

0 

0 


2,1 

8.4 xoa.o 

19 4- 

G.l 

7.7 

6.1 

2,6 

6.1 99.9 


CONCLUSION 

WhiJn aver ne’e tiinG, range and deviation decrease with increas¬ 
ing' eliroiiologicai and mental age* this decrease is not sufficient 
If) make clironologicnl or mental age a basis of standardization, 
since tiie inerease is firobably due purely to increasing motor 
eoordinntion which develops with increasing maturity. The better 
porformnnee with jncieasiiig oge, then, is not due to better con¬ 
trolled attention, since the variability of performance ns wensured 
hy the coefficient of variability shows no relation to age. 

There is no relation between performance in this test and in¬ 
telligence quotient, Viiriability on the test is due to some factor 
other 111 an maturity or general intelligence, presumably fluctuation 
of nltenlion. 

The inLcr-qnm'tile range of coclflcienta of variability for this 
group of 172 unselected cases was 11-18. A score within this 
range is considered average performance. 

A high coefHcicnt of variability hs accompanied by increasing 
total time of performance, increasing range of tirpe, and increas¬ 
ing deviation. 

Among caeca showing a high degree of variability (score of 
19there was a greater percentage found to be ‘'irritable,” “dis- 
fcractibJo,'^ "ineoherent*’ and ‘'slow in reaction,” Subjects described 
merely as "nei’vons and rosbless” were found not to show poor 
attention as measured by this test. Performance on the test 
showed thuL children described by observers in the home or 
school fts inattentive did nob necessarily make poor scores on this 
test, Observed inattention in these cases is evidently not a real 
lack of ability to attend, but is expressive of some other factors. 

Similar results were reported in a recent article^ on posfc-en- 
cephnlitic children, where it was found that, although those cases 
were described by observers as inattentive, by tests they proved 
capable of sustained nttcTition. The writers concluded that in 
their cases the apparent inattentivenesa was the result of emo^ 
tiorial disturbances®. 
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N ADVANCED COURSE IN EXPERIMENTAL. 
PSYCHOLOGY APPLIED TO ADVERTISING’" 


By A. J. Snow 
N orUiwestcni University 

It is obvious that the tonchinp: ol lulvortisiiiK ^vithout an ex- 
riincntnl laboratory is just as futile ns tenchiuk^ civil cnprinceriiig 
thoiiL a fiobl course in surveyiuj^. However, there is ii vital 
Terence bcUvecn Ihe two: in the latter easti an enj^ineeving 
idenL can chock up the correctness of his survoyiiif? with the 
\ o^ maLhematical computation; while in the case of psychology 
applied to advorUsinu; the student, at the present^ cannot 
rify his theories except by reference to a purchasing public to 
lich he has usually no access. NeverLbcless it is perhaps pos- 
iLg to bring this contact about—between the student of nclvcrtia- 
j and the purchasing public—by n cooperative plnn on the part,, 
the advertiser and the university. 

Obviously a student who would profit by such a cooper a tivar 
rangement cannot bo n beginner in the field, It is vital that 
should have some knowledge of the fundamentals of advertisings 
fore he is admitted to such a course. It has been our policy to 
ike the following prerequisites for the course in exporimentnl 
vertising: one semester of general elementary psychology, one 
marketing, and another semester in psychology as applied to nd- 
I'tising, We arc hoping that, in the last-named course, the student 
U become familiar with the application of psychological priuclplee 
the general field of advertising. To accomplisli this end, the 
ident is asked not only to rend published innterial and listen 
any new ideas brought out in the lectures, but also, na part 
his home work, to cidticise ndvertisonicuts, select samples 
advertising illustrating good and bnd applications of psychologi- 

1 principles, or lack of application, discover moclerii tendencies 
d solve any problems which were formulated by the instructor 
’ the purpose of applying psychological principles to advertising, 
me of theije problems were of the following nature: one such 
Dblem Was as follows—Explain why advertising is limited to 

2 use of only two of the four possible ways of pyoducing 
Mention. IlliistratG. For the second example take the case of 

Illinois farmer who wishes to advertise in Lite weekly newa- 

UphiI Iji-fiito tin* nijiiuiil int'eniig oC Tlie NiiIUhiiiI ANHurlnllfUi o[ TpiiclierH 
AOvortlHiiiR TiHM«rliip wllli TliP Assoclnled AUvi'i'liKlii4( CIuIib of LIh’ World,, 
nnlic City, June i\, 1U2.1 
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pnpevH in order to market by express some new potatoes direct 
to the consmicr. Three efood papers arc available, each covering 
flin'crLMit terviLory. A Cull page of space in any of them would cost 
liCLy clollars, .smiiller space in proportion. How can the farmer 
most profitably spend fifty dollars in advertising in a given week? 
Why? Here is still anolber problem—An advertising man lost his 
job, tlie reason l>eing that he arranged for an advertisement to 
appear every other month in a monthly miigaydnc. The excuse he 
gave was that the aji])ropriaLion was limited to the cost of only six 
issues. Why <lid Ibis advertising man get the worst of it? 

When n student has successfully completed this comparatively 
oleinentnry course in advertising he can, in his senior year, or 
while pursuing graduate studies, elect the advanced course in 
experimental psychology applied to advertising, He can pursue 
this course either one or two semesters, gaining academic credit 
proportionately to the work done, but not exceeding five credit 
hours during any one semester. The students in this course meet 
twice a week in one hour sessions for discussion and twice a week 
in three hour sessions for laboratory practice, 

The course itself is divided into two parts—^individual problems 
and class problcm.s. The first part—individual problems—is 
divided further into two parts, the division being based on the 
individual ability of the students in the group. The more pro¬ 
mising students are assigned problems of minor research, individ¬ 
ually or in groups, while the less capable students are assigned 
to perform standni'd laboratory experiments. For example, the 
following two arc gome of the problems of minor research assigned 
to the more capable students:—the /irst of these is an experi- 
meiUnl aUidy of the relative persuasiveness of types of adver¬ 
tising. Fifty types of advertising appeals were tried upon twelve 
Imndred day and night school students. The second problem 
was a study of the legibility of printing types as classified in 
groups with relation to their feeling tone. The less capable 
students were instructed to duplicate some of the well known ex¬ 
periments in the field of the psychology of advertising devised 
by siicli men as Scott, Gale, Hollingworth, and Strong. 

The .secoTid jiiirt of the course^ required of all students, aims 
to supply the need of an actual contact with the buying public, 
and also attemiits to bring before the students praciicnt problems 
of advertising, In this, the applied part of the course, the students 
were concerned with the actual field problems in advertising. 
While it is, ttii-ictli/ speaking, impossible to separate the actual 
business part of advertising from the application of psychological 
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inciples to advertising, practicalli/ nt least, that enn be done In 
measure. The reason for auch nn arbitrary division, into tha 
isineaa and the psychological oapecta of advertising, is that a 
urse in psychology connot tench tlie student how to run the 
laineaa na a whole but only how to apply paychological prin- 
plos to certain aspects of it. 

The success of this applied part of the course depends upon the 
)ility of the instructor in charge, or the university ns hla agent, 
obtain the good will and cooperation of two important groups: 
■at, small scale advertisers; second^ a group of representative 
■ofessional advertising men. The vicinity of the university to 
large industrial city, while not absolutely essential, lends itself 
lend idly to this purpose. 

Again in this apj)lied part of the course the class helps to 
the nature and function of the advertising which is 
'bmitted for its judgment by the small scale advertiser. In that 
ay the class has the opportunity to verify its experiments and 
e validity of its claims for the application of psychological 
.tegories to the adverUsing of merchanclise, just as much, as the 
iginoering student is able to verify his siirvcyinig dnta matlicmati- 
lly. In order not to go far wrong in the decisions of the class, 
id in this way waste time and money for its clients, the problems 
if ore the class and ihoir decisions arc discu-ssccl by the instructor 
OTTi time to time with the above-mentioned advisory board com- 
)aed of professional advertising men of high standing, chosen 
such a way that they as n group represent Lite vtirious types 
advertising agencies now in existence. 

It is important to under.stand that the .students in experimental 
Ivertising are not expected to represent artistically their ideas 
the making of the usual cut and copy. That is done for them 
id upon their bidding by professional artists and copy writers. 

- is not the function of this class, or any other in the field of 
jychology as applied to advertising, to tench the technique of 
irrying out ideas in the form of cut and copy. The function 
lUst always He with the schools of art and expression, and only 
ith those students who possess such a capacity. 

For the sake of clearness it may be expedient to state some of 
le field problema which made up the task for the clnas: 

First. A local storage and transfer company nsked the class 
) consider its advertising problem, especially during the months 
f April and May, September and October. 

Second. A Chicago advertising agency requested the class to 
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flug'g'eflt the method and the nature of the copy to be used in 
oitlor to put before the public a new type of baby carriage. 

Third, A large manufacturer of paint asked the claaa, through, 
his Chicago ndvertifiiiig agent, to prepare for his use a pamphlet 
of Information about the nature and utility of his merchandise, to 
be <listributGd by mail, coupon nttached. 

Faurtli. A manufacturer of gnrlcra requested the class to judge 
a secondary alogan with reference to its effect upon the potential 
buyer, and if necesBary to construct n new slogan more suitable 
foi* its purpo.se. 

This ia by no menna the only method that can be used to teach 
that sort of course, but it ia a method, we believe, that has had 
a certain degree of auceesa. The primary purpose of this paper,, 
however, is to stimulate n vigorous discussion of the subject it. 
presents. 



[EASURING THE COMPREHENSION OF ADVER¬ 
TISEMENTS 


By A. T. POFFENDEIIGEII 
Columbia University 


One of the most fundamental rules of fi writer or a speaker is 
lat he shall ^^come down to” or not po ”over the beads of his 
Lidience,” The speaker may pet un immediate reaction from his 
Lidience that will tell him whether or not he is obeying this rule, 
he writer, and especially the advertising copy writer, inny not 
Iways be so fortunate. Ilis returns from any one piece or series 
f pieces of copy may be cxtrcrncly slow and indirect, Where every 
oi’d costs many dollars, it is extremely important that each shall 
irry a message that will pay for itself and also bring a profit. 
0 be sure„ pictures will do mudi to carry the message, nnj may 
t the same time hide tlie unin tell igiblity of the copy. But even 
lotion pictures require some easily comprehended copy to make 
lem acceptable. 

Advertising, particularly national ridverUsing, is imis.s selling 
ad to be efTectivc must appeal to the bulk of the public, It ia not 
asy to know the ability of this vast public to comprebond the 
rinted message. In fact, no one acem.'i to have even gua.sscd at 
1 C level of intelligence, so culled, of the white popiiliition of tlie 
Ini ted States until the results of the Army intelligoiicc Lcsts were 
sported. The porcenLage of illiteracy has roccivod the most at- 
jntion, albho the much larger percenlEigo of low degree of literacy 
5 quite aa important, \\^e need not here coiiccm our.selvcs with 
le heated discussions as to whether ‘the average adult 1ms an 
itelligence of a thirteen, fourteen or sixteen yoar-old person. Most 
f these discussions center around the question whether printed 
ymbols ai*G adequate material for measuring native intelligence. 
V’e are here concemed with the capacity of the population to get 
he moaning of printed symbols, and with the degree to which 
le advertising copy-writer keeps within the limits set by the cap- 
city of the average person. 

Now the average adult can read, understand and deal with 
irinted symbols about as well as the 14 year old child, or one 
vho has completed the elementary schools grades. It is to an 
udience of no higher type than this, about one half of the coun- 
ry’s population, that the advertiser of generally used commodities 

<364) 
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must appcul. Thill is, this ilegree of capacity sets the limit beyond 
which the coj^y-^vritcr .should not go, * 

1 , To wluit (IcRroe does the copy-wviter adjust his vocobulary to 
hi.s audience? 

With our litUe knowledge of the make-up of the adveitisei's 
nudicncc, coni]dic;Ued by the shifting of maximum buying power 
from tlic professional classes to the laboring classes, it is not safe 
to cling to an unLosLcd opinion oji this matter. Moi’eaver, it is 
a quoHtion which lends ilsolf readily to experimental measurement, 
It one wants to know whether hi.s copy iij intelligible to his audi¬ 
ence lot him try it on trampling of that audience. The follow¬ 
ing studios arc intoncled to show whether or not such tests are 
necessary and at Llic .same time to show how they may be made. 

All tJic words, excluding the names of articles, were gathered 
from 100 lUlvertiscmGnts appearing in one issue of the '^Saturday 
Evening Post/' '*Thc J.adies' Ilo/no Journal” and the Woman’s 
Home Companion." There were in all 6378 words and when all 
i-epclitions of various sorts were eliminated, thoi'e remained S7&(5 
different words, Thi.s list of words was checked against the words 
nppeariiig in tJie "'i'eacher.'? Word Book," prepared by E. L. Thorn¬ 
dike. This i.s an alplnihoLical list of the 10,000 words occurring 
most commonly in a count of about 625,000 words from litei'atui’e 
for children an<l forty other sources. Of our list collected from 
the adverliKcincriLs, only <1 pez'cent failed to appear in the ^Teachers 
Word Book,” 'I’lie copy-writer therefore, seems to keep fairly well 
will]in (hHiHtf limits. 

Fiftnen of the wan’da appearing in both lists were chosen at 
random and presented to 37 persons, none of whom had gone 
tlu'Oiigli High School, who were asked to give their meaning. The 
percent of cnor.s for the diffei’cnt words including no answers 
and wrong an.swcr,s, ranged all the way from 2,7 percent for the 
word "reputation" to 73 percent for the word "zest." The average 
percent of error was 12 percent. Six words appearing in the ad¬ 
vertisement word list but not in the "Teachers Woi*d Book’* list 
were now tried on the same 37 people. The percent of errois 
ranged from 0 for "parasite" to CO percent for "slusJi,’ Ah 
though 37 people of elementary school grade do not form an ad¬ 
equate sample of any one class of the population, these figures 
suggest that even such a word list as that in the Teacheis oi 
Book" would not be an adequate guide for the copy-writer to 
follow if he ia to be cerLain of understanding on the part of hia 
audience. The percent of error was just as great for wor s ap 
pearing in the list as for those which were not in t e is . 

The following experiment with an actual advertisement show 
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le effect of the poor adjustment of an adve^tisemcnt^s vocabulary 
its nudience.i An advertisement of the poster type for Premium 
am contained the following statement: ‘'An Epicure's Way of 
aking Ham." The whole appeal lay in the meaning and connota^ 
on of the word "epicure" and must have been intended to produce 
favorable reaction in the lower half as well as the upper half of 
le population. 

Another advertisement was prepared, duplicating this one in 
fcry respect except that the word "Igorot" was substituted for 
le word "epicure." These two advertisements were shown to 
Lch of 63 housewives with the requests that they state which 
ay of baking ham seemed to them the more desirable. Twenty 
me chose the "epicure" advertisement while 24 chose the "Igorot" 
Ivertisement, indicating that they preferred to bake their ham 
le savage way. Since it appeared quite likely that some of the 
) who chose correctly may have been only guessing, they were 
iked to give their idea of an eqicuro, Seventeen of thorn showed 
lat they liad sufficient knowledge to make a collect choice,, 
hile the other 12 acknowledged that they knew tlie moaning of 
2 Lt]»er word and had no particular reason for their choice. Tliey 
id chosen one merely to comply with the investigator's request, 
ixty eight pei-ceht of this sample group had failed to get the 
leaning which was intended. Although the illustration carried 
le atmosphere of a very pleasing food and made llie advertise- 
lent a good one, another more readily understood \vor<l would 
U'tainly have added much to its effectiveness, 

2 To what degree does the copy-writer adjust his ideas to hig 
iidicnce? 

It is quite evident that a person may understand every word 
I a sentence and yet not get the meaning conveyed by the sentence 

3 a whole, may not get the idea in the mind of the writer. To 
etermine the degree to which the ideas presented in an advertise- 
lent arc grasped by the public a scries of tests was conducted, 
hese tests took the form of the Thorndike Reading Tests which 
re designed to measure the degree to which one understands what 
e reads. A passage is presented to be read along with a series 
f questions to be answered from the material read. In our tests 
n advertisement in its complete form together with a scries of 
uestions was used, or the copy of the advertisement was pre- 
mted in typewritten form together with a series of questions 
earing upon it. Nineteen sets of material representing different 
dvertiaeraaats were tested on more than 1,000 people. The ad- 
ertisements ranged in character from the simple Subway Car 
ird to the elaborate automobile advertisements. As it is impo.s- 



POFFEWnRRGER 


367 


siblc to present the clnla for all the advortifiements in sufficiently 
brief space, samples will he chosen to illustrate the method and 
the nature* of the I'osults. 

One Jumdml and seven New York Subway passengers were 

asketJ lo road the ucJverlisjng card lor the. Emulsion which 

conLuinod Llu‘ following copy; 

"Milk is tin eniuLsion. The —.. Emulsion is emulsified 

550 limes finer Limn milk and itH flit content is eight times richer 
kliari the host milk, Tlmt is why physicians and druggists nil over 
America, when askcul Lo name the finest emulsion, answer The 

• ’ . Emulsion. Tastes good—‘No Cod Liver Oil-Protects and 

Builds npulCh.'^ 

The following (fucBtions were asked and the answers recovclcd 
by the inve.sligtitor: 

1 , Whal is an emulsion? 

2 , Wluit does “emulsified 550 times finer than milk’* mean to 
you? 

3. What is it that makes milk an emulsion? 

4. Wliy does the . . Emulsion protect and build health? 

The answ’ers lo questions 1 and 3 demonstrated that none knew 
the essential ohavacleristicri of an emulsion, altho 46 percent 
knew tJnit an emulsion was fatty, To others it was merely a 
liquid and to still othens it was merely white. Answers ta ques¬ 
tion two shower I that none grasped the significance of the state¬ 
ment About 30 poicejil did say that it meant that the .... 

Emiilsioii is 550 limes better than milk. Altliough this belief is 
misleading it is not damaging to the product. Sixty-four percent 
believed that this emulsion, would protect and build health, be- 
cau.se “il i.s better than milk'* (24 percent) or because “it is recom¬ 
mended by pliysicians and druggists** (40 percent). Although this 
advertisement muy be considered effective, there is a great question 
whether the copy-writer really “put his ideas over,'* and obtained 
the maximum effect possible. 

Foi’ty xeven women, nil of whom looked like housewives, were 
asked to read the following car card, which is of the simple pub¬ 
licity sort: 

“. Golden Syrup. Made from Cane Sugar. For Table- 

For Cooking.** 

The questions asked were: 

1. Why should you buy a can of . Syrup? 

2- Why does cane sugar make goad syrup? 

3 . What other kind of sugar could We used to make syi-up? 
To question ono, eighty percent said they would buy it because it 
wns miifle from cane sugar. This was, of course, the only selling 
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lament pic sente d in the adverLisemcnt. But in answer to Lhe 
concf question it ^vas (fiscovoreri C/iat no one knew w/iy cane sug":!!’ 
nild malre good syrup. The answers to question 3 ^JJiowed that 
I ji or cent knew of no other kind of sugar from which syrup 
ight be mfidc. Further questioning of those who said they would 
ly this product showed that it was the prestige of Lhc trade 
ime that was effective, and tiuit the only actual reason given for 
lying this product Intd not done its worlc. . 

Following is the copy taken from an automobile advertiscTncnt 
id presented to 55 college men with the request that Llicy read 
and answer one question about it. 

"HiimaniLy may be u million yeav.s old in point of lime, but 
is as young as this moniing^s siin in its pursuit of the ideal, 
fter two thousand years of disappointment and disillusion, the 
ernnl verities and the eternal values still prevail , ,, , Even 

lOUgh it be surrounded and seemingly obscured by sham and 
’Gtense, nothing in thi.s world is discovered so surely as solid 
erit . This i.^ the truth that embodies all truLh; this is 

[G Irath that makes men free.*’ 

Thirty percent of the group could not answer the qiic.stion wliicli 
as: What is the truth that embodies all LriUh? As Lliey did 
)t discover Unit “nothing in this world is discovered so surely 
i solid meril,’^ they could seo no connection he tween this piira- 
•aph and un automobilie adverliscinont. One person who had 
id experience in copy ^writing agreed that might he part of 
poor adverLisemenL for a good automobiln.*" ft seemed useless 
t try this paragraph on less in to Hi gout groiqis of people, who 
. the same time might represent better automobile jirospecta 
lan the group used in our experiment. 

This paragraph was difficult or impossible to understand be- 
luse of its abstract ideas and the complicated character of its 
mstruction. Another case studied, that of a doube-page adver- 
soment foi‘ a new safety razor owed its difficulty to the wealth 
: technical details involving a greater knowledge of physics tlian 
I possessed by the majority of people, even of college student.s 
ha have had tJre advantage of a coai’se in physics. The uetual 
dvertisement was used in this experiment and its content is 
io long to reproduce in this connection. It is described in some 
3 tail in another article by the author*. All that need be mentioned 
ere is that of the 55 college students who were asked to answer a 
jries of 7 questions about this advertisement, with the privilege 
f consulting it as often as desired, practically none was able to 

T. PDffG)ibcrg<!r, .lourrinl of Annllwl PHycholoRy, 1023. 
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prasp tlic technical detaUs on which the success of the product 
depended. 

The study of the nineteen cases, of which those given are 
samples, .shows tliat advertising copy both in the vocabulary used 
and in the nature of the ideas presented frequently “goes over 
the heads of its audience." The trouble is frequently hidden in 
one or other of two ways or both. First, the excellence of the 
illustration may overcome the shortcomings of the copy or make 
tlie ftdverti.scment 3ucces.sful in spite of thd copy, That copy can 
convey the n\oat iibslmso ideas so that they shall be easily under¬ 
stood, the reading of the masterpieces of literature will show. Sec¬ 
ond, people may be convinced of the value of an article even when 
they do not undcv.stand what is said about it. But since we do 
not know tbo extent Lo which this sort of reaction prevails in 
human behavior it docs not seem safe to rely on' it for successful 
advertising. It i.H ii matter, however, which the student of Ap¬ 
plied P.sychology might well investigate, 

Tlie unfailing remedy for suspected unintelligible copy or copy 
that is (iirfjciilt to understand is, as suggested in the beginning of 
this paper, a very simple one. It is, “Try it on the audience," 
Take n sampling of that portion of the public to whon) the copy 
is lo appeal and by a scries of questions, carefully prepared be¬ 
forehand, find out just ivlinl i.v the reaction lo the copy. The 
J\;Pl)lie(l Psychologist who is intcresled in measuring and predicting 
lititiifin hoimvifir in ca.w.S’ of this .sort relics upon no genera] prin- 
ciplcM Lo guide him, but re.'^orts lo the method of sampling ju.st as 
the clicmiciil engineer or the phy.sical engineer tests his materials 
hV ihe method of sampling. And just as in these latter cases, 
skill is required in obtaining the samples, in measuring them, and 
ill drawing conclusions from the measurements. 

The advice of Robert Louis Stevenson to "Write so that the 
fool can understand you, and the wise man will understand you 
also," is, indeed, good, provided that one takes pains to discover 
what the fool can understand. 



NEWS AND NOTES 


The increased appropriation voted by the Eighty-fifth General 
jaembly of Ohio to the Bureau of Special Education and Psycho- 
iucational Clinic of Miami Univeraity, has Giiablcd the Bureau 
increase its staff, to enlarge its facilities for training teachers 
d supervisors for special classes for subnormals, deliiiqucnta and 
ccch defectives, and psychological examiners, and to open a 
nneh station in Cleveland. In addition to the director, J, E. W. 
allin, the staff includes the following: in the Dnyton center, Mrs. 
ssie Wilson, M. A,, University of Michigan, and Mias Janet 
jlcomb, M. A., Columbia University; Psychological examiners 
d instructors, Miss Mildred Grimes, D. A., Western Reserve and 
aduate student at Columbia, instructor in industrial arts, critic 
aeher and Miss Eva Nutting, student in the Bureau of Special 
iucation, Miami University, critic teacher; and in the Cleveland 
anch, Bertha M. Luckey, Pli. D,, University of Nebraska, and 
’evn Witherstay, critic teacher. 

Students are admitted from all sections of the country without 
her charges than a nominal registration fee. 

HTOCIAh KDTCATION. OHIO UNIVIOUKITY, ATIIMNS, OHIO 
The work in Special Eduention was established in the College 
Education of Ohio University, Athens, Ohio, in 1920 in con- 
iction with the Department of Psychology and Paidology. In the 
11 of 1922 this work in Special Education was made a separate 
irb of the Training School in order to take care of the Special 
asses in the City Schools of Athena na well as to meet the calls 
ming from the students desiring practice in schools for excep- 
)nal children. Miss M. Ln Vinia Warner, graduate of Columbia 
niversity, New York City, is directing the new department. 
Special facilities were already afforded by Ohio University 
r the preparation of teachers for this line of work because of 
.6 opportunity for the selection of subjects offered by the 
allege of Education and also the College of Liberal Arts to 
hich are now added the Special subjects further needed and the 
pecial School for exceptional children as a training school. The 
led for special education in the public schools of Athena and 
bbens County affords a wonderful opportunity for the study of 
1 types of exceptional children and the social conditions give 
udents n good opportunity for the study of and practical ex- 
jrience in Social Work. 

A group of fourteen students registered for the work in Special 
ducation in the 1922-23 term and thirty-seven students came in 
►r the Summer Session of 1923, The demand for the work is 
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growiiiR: i'a|in]Iy Uirouffluiut the State of Ohio aad more calls 
than can bo filled are coining' jn for tcEichcrs trained in this field, 

W. V. has Iummi elocLcd Editor and L. L. Thnrafcone 

Asfiocmte Editor of the Joiiriuil of Personnel Rcsearcln G. S- 
Yonhnni contiiuu's as Mnnaffin^- Editor of the Jonrnnl which is 
now entering on its second volume- Tho other members of the 
editorial board arc Wesley C. Mitchell, Alice Hamilfcon, Prank- 
wood E. AVillianis, It. \V. Husband, Matthew Woll, Leonard Oubh- 
wflite* Jim\}h IC. WillaLs, Lewis M. Torman, Alfred D. Flinn and 
Mary Van Kleck. 

This Jouninl is devoted to the scientific study of personnel. 
It publishes ovipjinal researches in the applied sciences that con¬ 
tribute to our knowledge nml oiiv clFective direction of people at 
work. It is the odicial organ of the Personnel Research Federation 
whoso purpose is tlic rurthernneo of research activities pertaining 
to personnel in industry, commerce, education and government 
wherever such rosearches nrc conducted in the spirit and with the 
methods of .science. It brings together workers in the biological 
and medical .sciences, psychologists, psychiatrists, engineers and 
economists who are making significant contributions to more exact 
knowledge of human beings at work and methods of making effect¬ 
ive and satisfying ndjustmonts between men and their work. 



BRITISH ASSOCIATION FOR THE ADVANCEMENT 
OF SCIENCE 


Toronto Meeting, August 6th to 13tii, 1924. 


SECTION J (PSYCIIOLOCV) 

Dear Sir (or Madam), 

A meeting* of tho Britisli Association for the Advancement of 
Science 'will be held at Toronto, from August 6Lh to 13Lh, 1924. 

The a£5sodation luis recently ailded to its various Sections a 
Section of Psychology. The Organising CoinmiUcc of the Psy¬ 
chological Section believes that the meeting will afford an uniciue 
opportunity for intercourse between psychologists of Canada, the 
United Stales, and Great Britainj and accordingly issues an invi¬ 
tation to any psychologist in the United States or Canada, who 
may desire to do so, to join the Association as a member for the 
Meeting, and to contribute a paper or attend the discussions. 

Professor McDougall, F.R.S., of Harvard University, has ac¬ 
cepted appointment as President of the Section; and it i.s hoped 
that he will deliver the presidential address.. Other papers have 
been promised by Dr, MoHon Pnnee, Dr, Brett, Dr, Bott, Dr. 
Bridges, Dr. Sandford, Dr. Tait, by Dr. Myers, Dr, Burt, Dr. 
Drever, Mr. Fliigel, Dr. Miles, Professor Pear, and other leading 
American and British psychologists. 

Joint Meetings have been arranged with the. following Sections;— 

Section H (Anthropology) to discuss "‘Racial Mental Di(Ter¬ 
ences.” 

Section I (Physiology) to discuss "Application of Physiology and 
Psychology to Industrial Efficiency,” 

Section L (Education) to discuss "Tests for Scholarships and 
Promotion.” 

Papers should not require more than. 20-30 minutes to rend; 
and intending contributors should send a notice of their papers 
before the end of March to the Recorder of the Psychological 
Sectidn (British Association), The Psychological Laboratory, The 
University, Leeds, England. Further particulars as to member¬ 
ship for the meeting can be had from the Secretaryi British Asfjoc- 
iation, Burlington House, Piccadilly, London, W.1-, EiighiTid; and 
notices of the general aiTangement will be issued in due cour.se by 
him and by tho Hon. Local Secretary in Toi'onto. 

We are, 

Yours faithfully, 

LL. WYNN JONES, Recorder, 

CYRIL BURT, President (1923) 

W. McDOUGALL, President (1924). 
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AmjKJIT S. OsisoiiNK, Tfir Pyr^hh m of Proof, pp. xxii + 525. 

M«Lllicw IJi'iifli'j’ lV: NrIV Yurk ami Albany, 

of p^jycliolfj^^y slinuld Iuia^c Access to this volumG 

hy Ihe (iiatiriKuiNlivcl antlifu' nf “(iui'stioiivifl J)ociimcnts.” Mr. 
Osljoni ha.K bevti u iHosc .^tuclrnt of luiniiui iiatui'c, esiiccially as he 
has ohMTvrd it in trial Ia^vyrl^s, jiulKt-Sp jurors, witness, iititraiita, 
and critniiiuls. [\v uucirrstiiiuh iJorcopLion and memory, rfBason- 
in^: and einotinu, tHi^^p'stion and porsuiision, credulity and deceit; 
and iie has Iumt i>uL down llnj rich ureumuliitions o[ his wisdom 
far lilt; Kaidaiici^ of trial iiLlonmys and the furthciaucc of jiislice. 

Of Ihi' Iwenly-aii^hl cluipUTs, llu* j)syelu}loR'ij^L will especially 
enjoy ll^oro: Sifliny; LIh‘ hMilomm, The Atmosphere of ii trial, 
(h’oss-JCxaminalinj), Memory am) I hi* Jh'Dof of Fnct.?, Advocacy, 
IVo'siujsjjm ajir! Jhaii'lienl i\syi;holofiy in Cmirls of Law, Form 
Jlliiidnn.'ss, Tho Di* inning* nml of Court Rooms, ami The 

in Dispuli'd IMoinnent Trials. The vocational counsellor 
and the prt/sprelive aUorney should reful» hegfinning: on pag'e 23d, 
Mr. (Ls-horn’s deserijilion (jf I ho miuircnionts of the great lawyer. 
Cfinicgio InsliUilG of 3'oollnolo^cy. W. V, Rikgham 

IIiiLKN T. Woor.LK'Y and ICLfZAni-iTii PArinis, DiuffnaBis and Treat- 
mc?t( of y<Jtnif/ Sc/iool Fa{li<r^s, Ru/lotin Uf23, No. I, p. II5, 10 
coiitn. Dopiulmenl of rntei'ior, Bureau of Education, Washing- 
tou, I). C. 

Ih)Lh tho Umclicr and the psychologist will appreciate this 
picture of what may he* accomplished with young school failures, 
Various mental and educiUionnl tests were Used in selecting the 
sixteen children far the "domonstration class.” Tho children in 
the class varied in chronological age from six years and seven 
inoiUhs to ten years mid four months, and the intelligence quo- 
lien U oF the first Lest varied from seventy-five to ninety-five, 

Tl)n children were grouped foi’ slufly into four dominant causes 
of Lheir dinicultic.s, a-S neglected children; high-grade defectives; 
special rlefrcLs in some one subject; and psychopathic children. 
I'hicJi type la reporlerl in the bulletin separately and each 
case is v<»ry eoinpictely reported, giving many helpful points in 
inidcrsfcfMidirig such children. 

Tlic! entire article is a plen for proper treatment and classj- 
fication of exceptional children. One of the besfc^ arpimenfcs for 
Slieciti! ICducaiimi thiit is shown in the hulletin in found in the 
discussion of tho changed attitude of the children towards school 
and life. This is certainly worthy of consideration. Anotlier is 
that tho inlelJigence quotients of these chjldroji increased With 
tiio .superior teaching- 

Ohio Univovsily. M. La Vinia Wakneb 

Bfrnaui) C. Eweh, Applied Pschologi/ pp- xliT-480. Macmillan 
Co., N. V. 1923. 

Psychology must be saved from her friends.^ Like many another 
well-favored jade of popular acclaim, she is m danger of having 
her name beeoiiio a by-word and a term of reproach to be thrown 
in Llic tooLJi of hei’ Loo much preoccupied guai’clians, the zunft of 
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Psychologists properly speaking, Wliile they are engagein 
cautious, painstaking effort to extend their own knowledge con¬ 
cerning her mysteries, interlopers and charlatans of all sorts are 
greedily capitalizing* the credulity of an uniformed public, to the 
■ultimate harm of both the public and the lady in question. 

To show that she's not at all that kind of a gal is the raison 
.(VHre of the volume here under review. To give the author's own 
statement, "There is a lack of literature which attempts to present 
in a readable form the principles, methocls, and results of scientilic 
j)sychology as applied to problems of everyday life." 

For those at all informed the author’s thesis needs no more than 
Rs statement to be accepted. Book shops, magazine stands, pop- 
■ular lectures by "nientalists,'^ all are moi’c or less shamelessly 
vending under the name of Psychology various nostrums concocLed 
at best under the animus of ignorant and misguided cuthusiusm, 
at worst with cynical disregard for intellectual decency and with 
unscrupulous motives of gain. The method and tecliiquea of 
science arc caviar to the general, who ns a rule prefer food of a 
dilTeronb sort. Any effort such ns the volume by Professor Ewer 
to cultivate a more discerning taste is wholly commendable. How¬ 
ever much psychologists may differ as to details of method and 
interpretation—and that honest differences of opinion do exist 
no one will deny—^there can he no clisngrcement on the general 
point of view espoused in this book, the point of view of any 
scientific discipline. 

The book is divided into four parts. Part I gives a treatment 
of Aims, Principles, and Methods, After a brief survey of pro¬ 
cedures and techniques as related to the aims of psychology a 
clarification of the concepts "subconscious," "unconscious,” and 
"suggestion" arc attc 7 nptGrI. Part II deals with Education and 
Everyday Life—a sketch of what is ordinarily thought of as 
coining within the purview of educational psychology. Under 
Mind and Health, the general heading for Part III, the author 
treats those things which are probably most frequently as¬ 
sociated with the term "psychology" for the layman—^i^sychonaly- 
si.s, psychotherapy in geiveral, faith healing, etc. Part IV con¬ 
cerns itself with a survey of the methods and problems of psy¬ 
chology as applied to industry ,^ind commerce. 

Probably any such popular introduction as this must be un¬ 
satisfactory from the standpoint of the special student. Thi.s 
would doubtless be true of science.^ much bettor organized than 
psychology. A wise friend of the reviewer once defined all 
teacliing as being a process of judicious lying. All of us who are 
engaged in the art necessarily have our individual notions as to 
wnau should be emphasized and what omitted. Since the book 
makes no pretense of being a compeiidium of all knowledge psy¬ 
chological, however, no strictures can properly be applied where 
the matter is still one of opinion among those qualified to judge, 
but only when questions of fact arise, 

One rather serious lapse in this connection is the statement 
that the coefficient of cor relation "in common use known na 

Gsiinid" 

'Pearson's coefficient of correlation is-." This formula 

IS not in common use for serious correlation studies nor is it Pear¬ 
son's formula. 
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A few other poinlr. <iii whieh psyrh(>lo^^)filM mi^rht honestly dilTej- 
mny he hih/Jy i/jentjnnrd. (i; The hfsiory of tliG two terms 
"unconscious" aiul "Mihefue-elmis" has nut hcen such r 3 to throw 
all the ()l)Io[iuy cU' veiiieM iiH'iiK a niythical potency rnthor than a 
icipnlihr rf>i)n j»L npoii ll)e ff>rijier, hh the nuthor i,s inclined to do, 
The aiKU^'o'nt lo*ri' reiMinrl.^^ oiu* of MeidiisCopheles' utivise to the 
sUnleiil ill /'’fij/’jf (o hatde only with wovdn. 

"Thuin ehen Wf> fehlen 

.’drill rin Wuvi zur i <'111 ten Zeit sich ein." 

(2) ^^Sn^^•on•^^'ilPll^ne!;» works ttirrhanirudif. It acts with a tc- 
^uiinrily of <;mse and elTeet which is distincL from ratioiinl seif- 
direclion and inh))>ilroM," (iinTy, aside frum the qiic.stion of faet; 
is a sW* lo’i' of ii' ychiilov.y iHissilih' on uny other basis than niGch- 
nnislic pnstulnlesy dHl 'Vu siihsuine under the general heading 
of “sp[>(*inl inli-llig(‘ntu» i<*sLm’' .such a diversity of tests as as- 
sodat<^K (oslii am) ,spo<ual nrlwevemcnt tests of all sorts (educa¬ 
tional tests) Icmis only furl her to befog nu already very cloudy 
issvie-'-os|M*L*ially for Lhi* lay jiarwui, (4) Tlie attempted clia- 
tinctioii htuwei'ii individiiar and "social" suggestion might be 
qiicstioned. (n) "TVhut is needed [in regard to religious psy- 
cholliorajiy 1 is ,.,.,..a iiun'c studied jivactico of suporposing religious 
failh upon nu’rlii'n) nna’/' (0) Thoro is a jw?i Hcffuitur in the ar- 
guriicnt for Ui<- hriirdiCary mciital tiiinilarity of siblings (r of .40 
fa .75, which means 10 to ,'fO per cent hotter than a sheer guess) 
jiiirLicularly wIumi the iiuLhor mlvJinecs this argument: ‘^_Espe> 
lally in twins i.s tb<» mental similarity ennspicuous, and since it 
is naf. stiliJstiiiUinlly gveiiter in (ddev Limit in younger twins ifc 
cuinuil Ih‘ ascrihed to I'dueation/' The relative weight of heredity 
vs, l•llVj|•^>nJnI.•Mt i.-s not rlemmmlrated in .such figures, or by such ar- 
gnmciiL. (7) In vm'w of tin* fact that “Freudian psychology'’ is 
dfprceatiMl gein^roiisIy-’-and some of Lhe psychoanalytic 1 it¬ 
er iiLu re cerla’inly warranlH this—it would scorn to have been only 
fair Ln hnv<' <liflV’i‘enlr/ited more carefuly between the pronouiice- 
nieuts of Freud an<( those of some of Ins ovci'-Gntlmsiasti<3 fol- 
lowev.s. "The recommendation of its [Freudian doctrine] cxtreine 
nrJvfiL’ale.s Ihnt one should refrain altogether from inierfeving with 
Liio ernoLions" is certainly cuiiliter to what Fi'eud explicitly states 
in his Chiuei'iil Inlroduclion t<» Psychoanalysis—which the author 
lists in hifi hihliognipiiy. 

TV'ill} it)] these strieiure.s llie present writov feels that the book 
ha.s a legitlinak* idace. The intelligent layman and the beginning 
sLiideuL sliould lin([ it of value. Part IV on Industry and Com- 
merci* is particularly w<dl done, and the chapter on Social ond 
Dlornl J'\ictors faces .some of the larger problems involved in 
human adjustments. 

Pui'due University HfiftMANN liKWMEaa 

Dunat.u a. Laiiu), Ph. D. Applied Psyckolof/y for Nurses pp. 
xi-|-2;ifb J. P, Uippiiicott Co., Philarlelphia, 1923. ^ . 

In thi.s Iritlc v<diime the author has "selected from the vast 
litovnlure of psycliology those facts of most immediate nio to 
nurses in iiialerstiimling the patient, themselves, and their fellow- 
incri," as announced on the paper cover. I should say that he 
lias flora* more tiuiii tluitj he has gone further into the preservea 
of biology Ulan many psychologists would venture a procedure 
fjuiU' eominoiaiable, 1 believe. , , , . r j 

Writteii in popular, newspaper English, the book should commend 
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itself to those with the umouiit of pi'elmiinary training that the- 
ordinary nurse has, as well ns beginning studeiitg oi psychology 
generally, The advanced student may be n bit irritated or even 
slightly scandalized at the irrcvcraiice inanifcated toward the 
household goda of psychology in some of the chapter and section 
headings—e,g., "Enter the VUlnin"; "A Practical Joke on a Sea- 
Anemone”; "The Moon and the Devil Blamed." 

As already intimated the book is biological and behavioristic 
ill viewpoint. It is divided into four parts. Part I alLoinpts to 
orient the student with reaped to the origin^ scope, and applications 
of psychology, with particular reference to mediciiie and nursing; 
this is done in twcnty-fivc pages. In Part IT, the most teclinical 
part of the book, the author treats the biological aspects and 
foundations of behavior. Part 111, enliUed '‘Apiilicutions,” is the 
piece de resistance', learning cndicronology, teniiicraiiients, in¬ 
stincts, psychoanalysis, suggestion,—these, talbhoiigh not all called 
by their first names, indicate the rubrics under which the dis¬ 
cussion may be classihed. Part IV is given over to somewhat more 
general, sociological applications of psychology and psychiatry, 
with parti eular v eg arc! to the suh)ect of mental hygiene. 

The author states in the preface that he has "endeavored to 
avoid all controversial matter not borne out by fact," and haa 
succeeded in the main. The chapter on The Temperaments in 
Nur.sing, however, offers opportunity for polemic to one contro¬ 
versially inclined. The ancient classification of the tenineramentg 
could well be improved from the modern point of view of abnor¬ 
mal psychology. To trace the inheritance of these various traits 
as unit chni’actors (p. 126) seems to me more than (luestionablo, 
the study of the Eugenics Record Office, which the author quotas, 
notwithstanding. Any mention of the glands of internal secretion 
upon behavior also opens up another debatable question, It is 
only fair to say, however, that the author treads rather lightly 
here. 

These strictures are, after all, only minor and largely theor¬ 
etical matters. There is sufficient warrant and need for n book 
of this sort to make it a valuable adjunct in the training of 
nurses. The portions of the book dealing with mental hygiene 
and the applications in general are well worthy the attention of 
the lay reader and beginning students generally. Unconvention¬ 
ally written as the book is, I am not prepared to state that this 
is a fault rather than a virtue» 

Purdue University Hermann Remmers 

Mead, Arthur Raymond, Learning and Teaching, Lippencott 
Company, 1923, pp. XI and 277. 

Learning and Teaching, as the title sugge.sts, is a study in 
applied psychology. The author has endeavored to cause the 
student of education to apply the general laws of psychology to 
a great variety of class-room problems. He has consciously at¬ 
tempted to do something that will aid in removing the source 
of much criticism against present-day teaching of psychology 
and education in our modern teacher-braining iiislituLions. There 
is the persistent critici.sm, often very bitter, that instruction in 
psychology and education fails to carry over from the teacher¬ 
training institution to the actual teaching of boys and girls. It 
is this criticism that has prompted Professor Mead to offer the 
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tcnchci-.H of this cininlry n jiow hook oJi tlio subject. 

Profc.'isor Moad Jiaw <l(!votc<l one half of his 277 pa^es to. 
cxerciJO.s anil icU-icuoas. 'lluwo exercises ami icCpioikes cover u 
wide raiiKC of Uiiiics. AinnnK Hie topics consiilerrtl are the follow- 
inp: The natiin? of human li'iirniiifr, Hk; [;ci,cral ami imllviclual 
fac'or.! llial influence IcnriiiiKf, (lie lniiisfc:r of learnliiB, the mcas- 
ureiiiont of menial finictioim. fi.sycJioiojrjpal coiid’tioi-.s concerned 
willi ihn ol<'MH*nUir,v and af'craidJirv mirl llic? jL^ycho^ogicsil 

coiuULion luvoKnl in rfluciitinnal melhods. Those topics receive 
a minimum uf ,sinin [n fnrc the cliHcushion of the text /m- 

(|UCHtiy is too iiinilotl to Llio studoiiL atlo(|U:itc Itnov/Jcilge of 
Iho priricljik* urif/fr cojisiikoatiori. ,Su?h infonnat'on. however, may 
bo roatlily ^^'llho^^ll hy the ►stiolpol from the excellent of 
lofomu’pK a}»}KOi(lc4{ In ^»JH h topiV, Tliio Jipproach to the subject, 
is fumlHar In Ihnso fjci|ii;iij)j rd >sii]» the Ihinci/Je.s of Teaching by 
Professor 'J'liornflikt*.. Tim iiirrils luuJ limitations of such an ap- 
pi'oncit are apparenU 

Professor A lead has done sCudents of education a real service' 
by coJIecliji/^ this extended li.st of varied exercises and by care¬ 
fully scloctjji^r references benrinjir on each topic. The exercises 
show flisci'iininutioii in their selection and arrangement, and with 
the proper use of tlio suggested references, should give satis¬ 
factory results. 


Loosmouw, W, CJIAUbKR, The Gain oj Personality/. E, P. Dutton- 
& Go. pp. 2HH, Price ^2,50, 

The Gain of Personality is a popular psychological statement 
of the x)ractical values of personality, In the course of his dis¬ 
cussion, the author has treated the nature, elements, and general 
cicvclopnicnt of personality. Kacli of the tliree major divisions 
is analyzed Into its component parts. Under the general head' 
of element of personality we find such sub-divisions as ihdiyid- 
ualiLy, sincerity, courage, enthusiasm, sensibility, self-expression,, 
humor, and vgdosc. 

The book offers clear evidence that the author js acquainted 
with hooks and men. He states his position clearly and with 
effecliveiiGK.H. Throughout he directs the reader's attention to 
those elements in tlie life of the individual necessary for suc- 
cQfjs. He points out wherein many people fail, and indicates 
the elements necessary to success, 

In brief tlic mission of the book is not to discuss personality 
^^tlieorctically or philosophically" but ^'practically and help¬ 
fully." A reading of the book should aid the individual in 
taking stock of Jij.s personal merits and limitations. 


Wklls, Gr-ioitCB Ross. Youth and the Oyjen Door. E. P. Dutton, 
1,922. pp. 175. Price $2.00. 

The book contains a series of lectures originally delivered to 
froslime/i in college. The purpo.se of the author is to piescnt 
to j’-oung- students certain laws of mental life whereby they 
may realize the largest benefits possible from them four years 
in college. ^Vifch this point in mind, the author has chscussert 
instinct, habit, remembering, attention, interest, thjnkmg, emo¬ 
tions, cau.s'cK of failure, choice of vocatioiij^ and chaiac , 

teTDporameiit. The discussion of these topics is non-technicai 
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in chavncter, ami is desiB’ned to make effective certain laws 
of psycholof^y. The author's psyclioloR-y is modern and its 
application to the task in hand is clear and judicious. 

The reader turns away from the book with tlic feeling tliat 
the effort of the author has been worthwhile. Ho has pointed 
out certain aids in the use of the mental powers that can not 
fail to benefit the student. It is certainly the type of book 
that should find its way into the hands of our youth who 
desire to make cconomc use of student days. 

On the whole the book is well written and places its message 
before the reader in an effective majmer. 

In brief it is an effort to apply lessons of psychology to the 
very processes which make possible psycbology. 

rioiCE, Roy Edward. The Jmprovewntit of Speed and Avenraeif in 
T}}pewriting. The Johns Hopkins University Studies in Edu¬ 
cation, 1922. pp. 42. Price 7E>c. 

Experimental studies in learning typewriting are not num¬ 
erous. Book's well-known study concerned itself chiefly with 
the psychology of skill. He did not stre.ss the imi)roveinent of 
speed, accuracy, or motbocl.s of teaching typewriting. 

In his study. Dr. Hoke has selected five definite que.stions 
for investigation; First, an investigation of the frcfivieiicy of the 
occurrence of letters and marks used in the English language^ 
Secoiitl, an examination of the number and di.'itribulioii of errors 
made in actual typewriting, and in so far as possible determine 
the cauFies of the errors; Third, a study of the relative ahilitie.s 
of the eight fingers and of the two hands; Fourth, ilie determi¬ 
nation of the loads or burdens of work placed by tlic present 
system upon the fingers ami hands; Pifth,^ an attcmi)t to j)C)int 
■ out the con.sidevation which mu.st ha admitted in an effort to 
arrange a keyboard on scientific principles, 

The study closes with a sugge.stod koyhuard together with 
certain criticism of the proposed changes in the key))oar(l. There 
is appended a bibliography of twenty-six Ulles, An would he 
expected most of the titles di.sciiss the more general problem of 
the ac(|uisition of skill. 

To the reviewer the .study deserves careful considoraiinii by 
those interested in teaching typewriting aiul who are anxious 
to produce a product with the highest .skill and accuracy. It at 
least sugge.sts a method of approach of iiive.stigatiJig ways and 
means of improving skill in one of the mo.sL widely usetl skills 
of man. 

IIOKR. Elmeu Rhodes. The Measurement nf Achievemrnt in 
Shorthand, The Johns Hopkins University Studios in Educa' 
tion, 1922, pp. 118. Price $1.50. 

In this monograph Professor Hoke gives an account of four 
scale.^ that l-^e hfis constructed for use in connection witli teach¬ 
ing Gregg Shorthand. The author recognizes the fact that tin* 
use of shorthand is a complex proccs.s, involving mental and 
motor factors. In his anuly.sis of the process, the author scloctu 
four important aspects for consideration. These imp or Ian t a.spccts 
are reading ability, ciuality of writing, speed of writing, and 
knowledge of the .system. A separate scale ha.s been constructed 
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of tciicliciH of ,,„niiric<l ysers of shorthand. 

Jnd consoMUcnlly >>otUM (|u.Uitic<i VfiLUS L. GAno 

Ohio Ui'ivcr.‘5ily 



NEW BOOKS AND PAMPHLETS RECEIVED’^ 

Booing and pamphlets for review ahould ho sent to James P* 
Portor, Department of Psychology, Ohio University, Athens, Ohio. 
Baudouin, L. CHAnLES. (translated by Fred RothwolK) The Birth 
of Psyche, E. P. Dutton & Companyp New York City. 2fl pp, 
Byrne, Lee, Latin Tests in loiva High Sc/loo/s. University of 
Iowa, lowA City, Iowa, 40 pp. 

Dickson, Virgil E. Mental Teats and the Clasf^rooin Teacher, 
World Book Company, Yonkera-on-Hudsonj N. Y. 231 pp. 
Ewer, Bernard G, Applied Paycholopyj Macmillan Company, 
New York. 480 pp. 

Fokbes. Joseph. Lehrbnck der Ex-pcriineiitellcn P^Hychologie, 
Herder & Co. G, m- b. li. Voiiaffsbiichhaiullung, Freiburg 
im Breisg'au. G31 pp. 

Gates, Arthur I. Psychology for Shulcnts of Education. The 
Macmillan Company, New York. 48fl pp. 

Halbert, L. A, What is Professional Social Work? The Survey, 
112 Fast loth St., New York City, 149 pp. 

Hall, G. Stanley. Lifo and Confessions of a Psyoholoyist. D, 
Appleton Company, New York. Friv,e 023 pp. 

HENDEnsON, C. A. Personal and Pnsinens Efficirncy. George H, 
Doran Company, New York. Price $2.00. 308 pp. 

Monsartiat, K. W, Tlealth and ihr I-Jithian Spirit. R. P. Dutton 
& Company, New York. Price ,$2.00. 132 pp. 

PUnTJCATIOKS ISSUED IlY 'I’llK ]JlOPAlM’.MKNT iU' IXTKllloU, 
UrRKAi: OP KIin'ATIDX. AVASIIINOTON, 1), (’. 

Americarmatio)i in the United Slates. John J. Mahoney. Bulletin 
. No. 31, 1023. 42 pp. 

Analytic S^irVey of State Coimes of Study for Rural Ekmentary 
Schools, Charles M. Jleinochl, Bulletin No. 42, 1922, UG pp. 
An Ainericani^ation Program, E. J. Irwin. Bulletin No. 30, 192.3. 
GO pp. 

Art EdncaiionH\ The Present SUiLation, Royal Bailoy Fumurn. 
Bulletin No. 13, 1923, 20 pp. 

Athletic Badge Tests for Boys and Girls. Physical Education 
Series No. 2, 1923. Prepared by the Playground and Rocrea- 
tion Association of America. 17 pp. 

Bihle in the Public Schools, William E. flood. Bulletin No. 16, 
1923. 13 pp. 

Child Health School. Conducted at the University of Chicago, 
1920. Lydia J. Roberta. School Health Studies. No* 2. 1923. 

60 pp. 

College Entrance Credits in Commercial Subjects. Glen Levin 
Swiggetfc, Commercial Education Leaflet No. 4, Anril. 1923, 

22 pp. ‘ ' 

•Mention Uora does not nrcelndc fiirUier comnunU. 
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Greiat. lUiral School LcaAct No. 12, 1923. 11 pp. 
Con^oLidiition of Sc/ioo^s of IVeUl County, Colorado. G. G. Sargent. 

Iluval School Leftflet No. 13, 1923, 11 pp, 

Educational Extension. Chnrlos G. Maphis. Bulletin No, 24, 1923, 
32 pp. 

Educational Ilyyicnc. Willard S. Small. Bulletin No, 33, 1923, 
3G pp. 

^Educational Rrogreftn and the Parents. Orville G. Brim Rural 
School Loiidcl No, ir>, May, 1923. 8 pp, 

.Educational Eurvc}fH, Edward Franklin Buchner. Bulletin No. 

17, 1923. 44 pp, 

/'I'diccafionri/ Work of The Kiii^/hts of Coluynbiis. Mark J, Swenny, 
Bulletin No. 22, 1923. 12 pp. 

Educational Work of the Yonyif/ Women*s Christian Association. 
By Education and Research Division, National Board of Y. 
\V. C. A. Bulletin No. 26, 1923. 24 pp. 

Enrollment in Forcifjn Langmioes, Science and Commercial Sub¬ 
jects in Public Hiyh Schools. Florence DuBois. Statistical 
Circular No. 2, May, 1923. 9 pp, 

Fedcr(Ll Aid to Public •S'c/ioo/, 9 . Fletcher Harper Swift. Bulletin 
No. 47> 1922. 47 pp. 

Hampton Norynal aiwl Ayricultiiral Jnsiihde. Walton C. John, 
lliilletiii No. 27, 1923. 116 pp. 

Jlifjkvr Education^ 1920-1922. George F, Zook. Bulletin No. 34, 
1923. 33 pp. 

Ilistorif of the Training School of Washington Unirevsity. 

(SL. Louis Training .School.) Charles Penney Coates. Bullo- 
till No. 3, 1923, KG pp. 

noma Evonomivs Educaiiou. Henrietta W. Caivm. Bufietin No. 
0, 1923. 19 pp. 

Jo^va l*lun of Traininfj SupeyinUndents and Teachers for Consoli- 
dated Schools. Macy Campbeli. Rural School Leaflet No. 17, 
Juno, 1923. 

Junior High Schools of Bevkcleyf Caii/o?')iia. James T. Preston 
and oLliers, Bulletin No. 4, 1023. 48 pp. 

Main Streets of the Nation, A Series of Projects on Highway 
Ti’nnsport for Elementary Schools. Florence C. Fox. Bulletin 
No. 38, 1923, 42 pp. 

Medical Edncalion, in2Q-1922. N. P. Colwell, M, C. Bulletin No, 

18, 1923. 17 pp. 

OhjecMves in Elementary Rural School Agriculture. E. E. Windes. 

Rural School Leaflet No. 11, March, 1923. 18 pp, 
•Organization and' Conduct of Bzisinesa. Glen Levin SwigE^tt, 
Coinmerciai Educction Leaflet No. 5, June, 1923. 18 pp. 

Principles of Kinder gar ten-Prhnai'y Education in the Consolidated 
Rural School. Katherine M. Cook. Rural School Leaflet No, 
18, June, 1923. 9 pp. 

P?'Off?'ea.^ive Tcndeyidcs in Eiiropean Education. C, W. Waahburne. 
Builotin No- 37, 1923. 31 pp. 
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Public Education in Oklahoma, Bulletin No. U, 1923. 92 pp. 

Public School System of Ai'ka7isa3. Bulletin No. 11, 1923, 110 pp. 

Recent Advances in Instruction in Music. Will Enrhart and 
Charles N, Boyd, Bulletin No. 30, 1923. 21 pp. 

Recent Developments in EducationalJournaliom, W. Carson Ryan, 
Jr. Bulletin No. 25, 1923. 14 pp. 

Record of Current Educath7ml Publications, Bulletin No. 32, 1923, 
30 pp. 

Rejerences on Education of |Vo?nc?i in the United States. Library 
Leaflet No. 10, April, 1923. 7 pp. 

References on Preschool and Kindergarten-Primary Education. 
Nina C. Vandewalker and Harriet E. IIo^vnrd. Kindergarten 
Circular No, 14, July, 1923. Price per copy 6 cents. 11 pp, 

Rural-Teacher Situation in the t7?ii£cd States. Mabel Carney. 
Rural School Leaflet No. 14, May, 1923. Price per copy 6 

12 pp. 

School Building Program for Washington, North Cai'oUna. Alice 
Barrows. Bulletin No. 2, 1923, 20 pp. 

School Support and School Indebtedness in Cities. Florence Du- 
Boia, Statisticcal Circular No. 3, June, 1923. 5 pp. 

Social Studies m Civic Educatio^i. Edgar Dawson. Bulletin No. 
23, 1923. IG pp, 

jSo)ne Industrial Art Schools of Europe. Mnrius Vnehon. Trana^ 
Intion by Florence N, Levy. Bulletin No. 48, 1922. J59 pp. 

State Policies in Public School Fmance, Fletcher Harper Swift. 
Bulletin No. 6, 1922. 64 pp. 

Statistical Survey of Education, 1010-1920. Florence DuBoi.T, 
Bulletin No. 16, 1923. 41 pp. 

Siaiisiics of City School Systems, 19li>-lf}20. H. R, Bonner. BuL 
letin No. 17, 1922. 173 pp. 

Statistics lielathuj to Business Fdi(ca£io?i in Colleges and Univer¬ 
sities, 1921-1922. Glen Levin SwiRgetL, Commercial Educa¬ 
tion Leaflet No. 6, June, 1923. fi pp. 

Supervimon of Onc-Teacher Schools. Maud C. Newbury. Bulletin 
No. 9, 1923. 66 pp, 

Vocaiionai Education. William T. Bnwden. Bulletin No. 28. 1923. 
2G pp. 

Robinson, George Edwin. Scie^itific Salesmanship. Three Vol¬ 
umes. American College of Scientific Salesmanship, Chicago, 

Skaggs, Ernest Burton. Elementary Text Book of Mc 7 itaZ Meas¬ 
urements. George Wahr, Publisher, Ann Arbor, Mich. 169 pp. 

Starch, Daniel. Principles of Advertising. A. W, Shaw Com¬ 
pany, New York. 998 pp. 

Wateb, George Frederick. The Magic of Co^nmon Schhc. E. P. 
Dutton & Compnny, New York, Prica ^l.CO, 107 pp. 

Wood, Ben D. Me(t8ii7'C7ncnt in Higher Education. World Book 
Company, Yonkera-on-Hudson, N. Y. 337 pp. • 
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